-- Logs begin at Fri 2022-09-09 11:25:30 UTC, end at Fri 2022-09-09 12:37:54 UTC. -- Sep 09 11:57:38.571108 dv-cinder-852210-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 11:57:38.580567 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 11:57:38 2022] *** Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: nodename: dv-cinder-852210-13-iscsi Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: machine: x86_64 Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: clock source: unix Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: pcre jit disabled Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: detected number of CPU cores: 4 Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: current working directory: / Sep 09 11:57:38.582576 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: detected binary path: /usr/bin/uwsgi-core Sep 09 11:57:38.583207 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: your processes number limit is 47680 Sep 09 11:57:38.583207 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: your memory page size is 4096 bytes Sep 09 11:57:38.583207 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: detected max file descriptor number: 2048 Sep 09 11:57:38.583207 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: lock engine: pthread robust mutexes Sep 09 11:57:38.583207 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: thunder lock: enabled Sep 09 11:57:38.583207 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 11:57:38.583207 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 11:57:38.621424 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: Python main interpreter initialized at 0x556a92fb59c0 Sep 09 11:57:38.621424 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: python threads support enabled Sep 09 11:57:38.621424 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: your server socket listen backlog is limited to 100 connections Sep 09 11:57:38.621424 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: your mercy for graceful operations on workers is 90 seconds Sep 09 11:57:38.621796 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 11:57:38.621963 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: *** Operational MODE: preforking *** Sep 09 11:57:38.622080 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: *** uWSGI is running in multiple interpreter mode *** Sep 09 11:57:38.622080 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: spawned uWSGI master process (pid: 105685) Sep 09 11:57:38.622272 dv-cinder-852210-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 11:57:38.624192 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: spawned uWSGI worker 1 (pid: 105686, cores: 1) Sep 09 11:57:38.624192 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: spawned uWSGI worker 2 (pid: 105687, cores: 1) Sep 09 11:57:38.624192 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 11:57:39.279334 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 11:57:39.280584 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 11:57:40.363527 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:40.363527 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: from cryptography.utils import int_from_bytes Sep 09 11:57:40.364098 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:40.364098 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: from cryptography.utils import int_from_bytes Sep 09 11:57:40.366059 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:40.366059 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: from cryptography.utils import int_from_bytes Sep 09 11:57:40.366550 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 11:57:40.366550 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: from cryptography.utils import int_from_bytes Sep 09 11:57:42.843638 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:57:42.844211 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:57:42.844394 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:57:42.844753 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:57:42.845013 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:57:42.845402 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.845725 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.846042 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.846381 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.846599 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 11:57:42.847008 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.847103 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 11:57:42.847190 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.847310 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.847408 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 11:57:42.847625 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.847721 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 11:57:42.847936 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 11:57:42.848024 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.848199 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.848316 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.848512 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.848638 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.848836 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-13-iscsi {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.848955 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.849156 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.849257 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.849461 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.849582 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.849768 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.849889 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.850082 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.850228 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.850406 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.850543 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.850727 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.850867 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.851030 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.851125 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.851421 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.851550 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.851742 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-13-iscsi {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.851946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.852072 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.852254 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.852369 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.852566 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.852695 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.852908 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.853049 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.853215 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.853351 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.853610 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.854247 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.854411 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.854540 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.854850 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.854938 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.855174 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.855562 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.855754 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.855856 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.856061 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.856167 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-13-iscsi {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.856393 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.856495 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.856725 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.856835 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.857015 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.857112 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.857336 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.857441 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.857641 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.857746 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.857959 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.858049 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.858294 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.858395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.858718 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.858837 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-13-iscsi {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.858988 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.859077 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.859298 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.859387 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.859612 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.859708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.859925 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.860020 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.860243 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.860332 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.860543 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.860631 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.860848 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.860953 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.861155 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.861251 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.861472 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.861569 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.861774 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.861870 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.862076 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.862201 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.862345 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.862442 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.862649 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.862747 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.862968 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.863056 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.863291 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.863397 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.863589 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.863692 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.863831 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.863926 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.864070 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.864201 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.864386 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.864506 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.864701 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.864797 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.865032 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.865133 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.865310 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.865435 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.865620 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.865715 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.865923 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.866032 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.866211 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.866327 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.866459 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.866556 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.866792 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.866894 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.867095 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.867184 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.867400 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.867488 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.867705 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.867795 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.868009 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.868104 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.868311 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.868404 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.868610 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.868700 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.868912 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.869002 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.869241 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.869338 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.869544 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.869633 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.869858 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.869959 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.870193 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.870284 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.870500 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.870597 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.870802 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.870889 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.871120 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.871221 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.871425 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.871520 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.871728 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.871816 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.872031 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.872129 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.872346 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.872435 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.872670 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.872756 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.872971 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.873067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.873203 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.873293 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.873833 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.873944 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874014 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874091 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874198 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874291 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874425 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874598 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874756 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.874914 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.875004 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.875282 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.875401 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.875544 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.875673 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.875827 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.875907 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.876077 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.876189 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.876377 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.876476 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.876700 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.876793 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877005 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877094 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877308 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877408 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877608 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877695 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877903 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.877999 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.878227 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.878335 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.878529 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.878617 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.878833 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.878922 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.879135 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.879225 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.879434 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.879531 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.879734 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.879830 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.880033 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.880129 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.880333 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.880421 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.880633 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.880722 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.880934 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.881022 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.881246 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.881333 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.881548 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.881635 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.881850 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.881947 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.882177 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.882285 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.882482 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.882570 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.882783 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.882871 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.883097 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.883193 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.883395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.883485 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.883694 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.883782 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.884006 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.884100 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.884307 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.884395 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.884608 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.884699 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.884934 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.885028 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.885233 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.885331 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.885534 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.885649 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.885836 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.885935 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.886289 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.886391 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.886483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.886573 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.886724 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.886813 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.887038 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.887140 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.887339 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.887435 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.887640 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.887730 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.887940 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.888043 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.888240 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.888329 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.888538 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.888634 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.888839 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.888941 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.889138 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.889226 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.889434 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.889534 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.889749 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.889848 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.890065 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.890173 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.890398 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.890486 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.890704 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.890802 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.891006 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.891141 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.891324 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 11:57:42.891420 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.891660 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.891803 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.891976 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.892072 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.892286 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.892375 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.892594 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.892685 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.892908 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.892997 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.893225 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.893322 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.893554 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.893657 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.893863 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.893951 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.894194 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.894299 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.894511 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.894612 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.894818 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.894914 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.895128 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.895237 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.895437 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.895533 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.895751 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.895857 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.896059 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.896168 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.896381 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.896472 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.896701 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.896789 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.897014 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.897159 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.897328 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.897417 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.897634 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.897733 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.897941 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.898038 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.898272 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.898364 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.898582 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.898672 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.898891 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.898980 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.899216 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.899312 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.899525 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.899614 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.899841 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.899931 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.900151 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.900247 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.901002 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.901093 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.901313 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.901408 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.901620 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.901715 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.901925 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.902012 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.902255 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.902361 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.902566 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.902663 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.902887 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.902983 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.903199 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.903292 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.903505 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.903632 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.903816 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.903913 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.904123 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.904218 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.904431 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.904528 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.904737 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.904881 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.905043 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.905131 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.905348 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.905435 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.905651 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.905749 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.905954 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.906058 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.906285 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.906386 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.906591 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.906694 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.906894 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.906983 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.907221 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.907316 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.907518 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.907607 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.907826 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.907915 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.908133 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.908229 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.908435 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.908532 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.908736 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.908832 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.909039 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.909128 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.909343 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.909432 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.909641 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.909741 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.909947 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.910034 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.910275 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.910379 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.910580 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.910677 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.910900 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.910999 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.911203 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.911291 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.911502 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.911625 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.911822 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.911929 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.912124 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.912233 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.912427 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.912523 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.912737 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.912836 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.913045 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.913135 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.913352 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.913440 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.913661 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.913809 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.913967 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.914066 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.914309 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.914402 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.914618 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.914709 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.914926 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.915025 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.915228 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.915316 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.915539 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.915629 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.915848 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.915945 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.916723 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.916826 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.917034 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.917134 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.917348 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.917446 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.917669 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.917759 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.917979 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.918070 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.918318 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.918407 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.918622 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.918793 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.918923 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.919021 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.919229 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.919318 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.919530 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.919629 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.919833 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.919923 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.920137 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.920235 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.920437 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.920536 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.920738 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.920827 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.921037 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.921124 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.921339 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.921436 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.921638 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.921726 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.921939 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.922026 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.922262 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.922366 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.922564 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.922652 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.922865 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.922955 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.923164 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.923254 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.923464 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.923560 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.923781 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.923919 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.924087 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.924177 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.924386 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.924484 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.924686 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.924774 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.924988 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.925112 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.925326 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.925428 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.925628 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.925740 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.925934 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.926031 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.926275 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.926389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.926586 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.926721 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.926905 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.927009 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.927216 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.927336 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.927529 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.927641 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.927833 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.927930 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.928141 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.928250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.928444 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.928550 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.928766 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.928867 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.929069 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.929167 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.929378 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.929477 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.929696 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.929794 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.930006 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.930103 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.930338 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.930439 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.930649 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.930746 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.930953 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.931062 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.931256 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.931361 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.931588 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.931731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.931904 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.932002 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.932219 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.932325 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.932528 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.932632 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.932842 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.932947 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.933147 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.933244 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.933459 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.933558 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.933765 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.933890 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.934069 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.934195 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.934394 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.934507 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.934698 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.934812 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.935012 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.935111 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.935319 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.935418 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.935631 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.935745 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.935936 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.936035 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.936250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.936359 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.936553 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.936659 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.936862 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.936979 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.937165 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.937282 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.937465 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.937555 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.937769 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.937860 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.938077 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.938204 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.938413 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.938504 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.938718 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.938806 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.939025 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.939121 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.939329 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.939419 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.939635 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.939722 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.939940 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.940041 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.940240 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.940337 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.940542 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.940665 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.940847 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.940955 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.941159 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.941259 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.941465 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.941563 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.941770 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.941876 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.942072 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.942213 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.942404 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.942502 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.942706 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.942813 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.943007 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.943103 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.943310 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.943409 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.943606 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.943713 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.943913 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.944023 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.944218 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.944317 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.944537 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.944654 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.944847 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.944936 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.945148 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.945302 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.945451 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.945546 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.945766 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.945854 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.946073 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.946182 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.946401 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.946493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.946707 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.946803 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.947009 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.947100 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.947359 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.947451 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.947671 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.947759 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.947976 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.948064 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.948283 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.948380 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.948592 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.948682 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.948897 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.948995 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.949203 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.949299 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.949509 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.949598 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.949817 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.949915 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.950168 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.950262 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.950557 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.950653 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.950862 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.950970 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.951177 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.951273 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.951492 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.951644 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.951906 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.952104 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.952293 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.952438 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.952622 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.952769 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.952955 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.953110 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.953345 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.953483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.953731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.953832 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.954041 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.954176 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.954429 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.954530 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.954794 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.954889 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.955103 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.955435 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.955524 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.955759 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.955865 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.956063 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.956154 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.956377 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.956467 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.956725 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.956815 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.957035 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.957176 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.957343 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.957515 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.957653 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.957843 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.957957 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.958177 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.958272 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.958487 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.958586 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.958797 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.958887 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.959102 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.959191 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.959408 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.959498 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.959717 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.959813 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.960022 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.960120 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.960325 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.960415 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.960629 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.960725 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.960934 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.961032 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.961235 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.961328 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.961536 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.961624 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.961836 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.961932 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.962160 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.962252 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.962478 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.962568 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.963280 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.963390 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.963625 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.963721 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.963931 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.964019 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.964252 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.964365 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.964564 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.964665 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.964863 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.964951 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.965164 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.965253 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.965464 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.965551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.965772 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.965869 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.966080 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.966205 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.966405 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.966495 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.966713 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.966816 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.967020 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.967109 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.967330 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.967429 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.967637 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.967743 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.967938 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.968037 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.968245 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.968334 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.968547 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.968645 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.968853 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.968941 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.969157 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.969245 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.969460 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.969560 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.969757 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.969845 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.970063 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.970172 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.970394 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.970486 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.970698 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.970786 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.971004 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.971091 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.971303 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.971401 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.971609 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.971698 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.971911 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.972007 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.972212 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.972302 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.972515 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.972605 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.972815 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.972902 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.973118 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.973208 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.973415 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.973504 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.973719 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.973815 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.974020 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.974135 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.974350 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.974438 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.974655 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.974769 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.974957 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.975054 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.975257 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.975356 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.975555 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.975652 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.975855 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.975943 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.976162 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.976258 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.976467 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.976565 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.976768 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.976857 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.977076 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.977173 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.977381 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.977478 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.977688 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.977826 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.977984 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.978072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.978313 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.978425 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.979176 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.979300 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.979481 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.979573 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.979789 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.979890 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.980093 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.980191 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.980664 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.980752 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.980964 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.981073 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.981272 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.981361 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.981575 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.981672 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.981880 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.981968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.982203 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.982296 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.982513 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.982616 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.982815 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.982905 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.983119 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.983216 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.983421 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.983521 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.983725 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.983821 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.984028 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.984117 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.984348 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.984449 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.984654 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.984802 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.984956 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.985045 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.985256 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.985354 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.985555 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.985643 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.985864 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.985952 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.986194 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.986305 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.986501 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.986596 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.986803 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.986892 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.987127 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.987218 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.987439 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.987536 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.987749 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.987845 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.988055 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.988144 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.988368 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.988457 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.988671 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.988761 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.988976 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.989072 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.989282 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.989370 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.989590 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.989687 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.989890 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.989978 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.990216 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.990309 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.990525 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.990631 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.990835 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.990932 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.991141 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.991299 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.991449 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.991552 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.991763 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.991852 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.992072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.992169 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.992374 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.992471 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.992679 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.992774 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.992984 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.993071 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.993285 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.993374 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.993591 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.993680 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.993898 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.993989 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.994246 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.994351 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.994559 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.994656 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.994871 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.994968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.995166 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.995256 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.995468 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.995558 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.995795 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.995882 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.996104 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.996201 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.996413 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.996502 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.996719 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.996818 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.997044 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.997132 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.997352 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.997440 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.997661 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.997761 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.997971 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.998100 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.998295 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.998384 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.998605 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.998707 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.998909 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.998998 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.999301 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.999390 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.999609 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.999708 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:42.999915 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.000004 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.000218 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.000315 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.000524 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.000612 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.000835 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.000924 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.001136 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.001225 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.001440 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.001531 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.001741 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.001828 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.002060 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.002203 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.002390 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.002495 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.002711 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.002800 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.003064 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.003152 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.003369 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.003466 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.003670 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.003759 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.003978 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.004113 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.004299 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.004425 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.004601 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.004733 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.004902 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.005050 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.005205 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.005360 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.005524 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.005681 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.005827 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.005972 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.006164 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.006307 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.006580 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.006680 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.006889 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.006978 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.007191 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.007304 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.007524 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.007613 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.007837 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.007939 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.008141 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.008241 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.008462 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.008551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.008781 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.008871 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.009093 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.009187 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.009407 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.009495 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.009740 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.009985 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.010088 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.010378 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.010470 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.010690 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.010780 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.010996 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.011097 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.011308 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.011398 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.011611 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.011701 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.011917 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.012080 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.012228 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.012318 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.012532 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.012629 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.012835 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.012948 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.013155 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.013366 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.013456 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.013686 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.013789 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.013995 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.014093 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.014342 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.014442 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.014655 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.014754 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.014960 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.015089 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.015265 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.015353 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.015571 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.015669 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.015874 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.015961 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.016179 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.016268 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.016499 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.016598 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.016801 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.016890 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.017105 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.017194 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.017411 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.017508 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.017721 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.017818 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.018023 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.018130 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.018349 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.018439 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.018651 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.018742 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.018959 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.019047 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.019279 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.019368 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.019589 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.019677 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.019910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.020009 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.020229 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.020326 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.020536 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.020624 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.020855 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.020956 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.021163 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.021253 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.021466 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.021554 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.021770 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.021869 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.022073 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.022191 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.022420 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.022517 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.022724 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.022827 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.023029 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.023118 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.023337 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.023426 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.023639 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.023729 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.023944 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.024035 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.024248 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.024338 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.024556 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.024646 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.024859 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.024948 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.025161 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.025257 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.025988 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.026086 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.026333 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.026425 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.026637 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.026726 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.026939 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.027036 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.027248 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.027337 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.027545 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.027642 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.027847 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.027942 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.028147 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.028243 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.028451 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.028547 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.028750 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.028847 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.029050 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.029146 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.029352 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.029453 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.029670 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.029759 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.029971 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.030067 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.030315 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.030421 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.030623 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.030711 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.030923 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.031020 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.031225 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.031316 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.031527 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.031660 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.031861 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.031951 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.032164 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.032260 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.032475 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.032563 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.032780 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.032868 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.033093 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.033182 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.033404 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.033620 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.033710 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.033948 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.034046 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.034285 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.034377 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.034601 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.034702 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.034915 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.035006 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.035226 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.035354 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.035535 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.035630 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.035843 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.035933 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.036153 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.036285 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.036460 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.036561 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.036769 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.036979 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.037095 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.037302 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.037414 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.037615 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.037737 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.037925 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.038071 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.038261 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.038397 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.038573 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.038715 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.038881 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.039030 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.039190 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.039347 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.039498 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.039701 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.039804 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.040012 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.040103 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.040317 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.040408 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.040631 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.040732 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.041517 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.041617 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.041849 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.041942 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.042194 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.042290 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.042508 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.042615 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.042824 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.042922 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.043135 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.043230 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.043444 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.043545 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.043754 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.043845 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.044067 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.044157 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.044376 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.044474 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.044691 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.044781 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.045004 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.045093 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.045315 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.045452 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.045623 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.045713 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.045934 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.046023 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.046267 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.046403 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.046577 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.046781 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.046884 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.047094 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.047195 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.047427 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.047516 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.047748 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.047838 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.048073 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.048171 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.048402 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.048507 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.048698 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.048788 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.049018 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.049109 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.049322 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.049419 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.049627 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.049836 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.049936 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.050168 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.050263 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.050502 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.050591 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.050824 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.050927 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.051148 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.051250 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.051448 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.051547 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.051760 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.051849 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.052068 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.052156 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.052373 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.052599 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.052702 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.052944 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.053035 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.053262 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.053353 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.053562 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.053664 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.053880 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.053978 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.054211 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.054303 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.054514 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.054616 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.054856 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.054970 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.055136 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.055225 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.055443 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.055702 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.055801 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.055989 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.056139 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.056304 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.056405 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.056669 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.056784 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.056994 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.057140 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.057311 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.057410 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.057615 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.057718 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.057938 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.058036 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.058271 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.058365 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.058576 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.058683 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.058893 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.058982 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.059202 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.059300 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.059504 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.059595 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.059809 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.059908 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.060118 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.060209 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.060425 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.060513 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.060726 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.060815 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.061027 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.061117 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.061324 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.061412 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.061627 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.061716 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.061934 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.062025 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.062259 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.062352 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.062563 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.062664 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.062871 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.062960 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.063173 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.063262 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.063475 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.063573 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.063777 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.063868 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.064078 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.064168 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.064379 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.064477 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.064679 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.064770 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065009 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065123 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065289 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065394 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065597 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065798 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065885 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.065966 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.066265 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.066369 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.066563 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.066652 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.066883 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.067093 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.067197 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.067427 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.067517 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.067746 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.067836 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.068067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.068165 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.068387 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.068476 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.068692 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.068792 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.068996 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.069095 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.069303 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.069392 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.069627 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.069718 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.069937 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.070175 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.070270 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.070511 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.070600 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.070831 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.071000 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.071159 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.071255 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.071467 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.071557 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.071772 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.071871 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.072076 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.072191 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.072414 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.072505 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.072723 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.072814 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.073031 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.073120 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.073335 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.073424 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.073641 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.073739 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.073947 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.074042 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.074279 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.074381 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.074588 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.074677 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.074896 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.074986 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.075206 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.075305 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.075513 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.075604 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.075822 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.075911 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.076128 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.076225 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.076433 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.076522 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.076737 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.076824 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.077041 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.077138 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.077350 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.077446 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.077677 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.077767 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.077990 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.078079 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.078340 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.078479 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.078672 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.078974 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.079101 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.079281 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.079383 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.079591 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.079692 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.079897 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.080011 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.080202 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.080310 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.080515 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.080661 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.080843 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.080941 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.081163 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.081258 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.081452 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.081550 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.081763 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.082095 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.082240 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.082449 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.082537 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.082769 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.082873 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.083088 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.083178 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.083390 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.083488 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.083698 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.083798 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.084002 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.084091 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.084310 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.084400 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.084627 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.084716 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.084934 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.085024 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.085243 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.085338 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.085548 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.085646 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.085858 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.085948 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.086185 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.086293 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.086492 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.086598 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.086795 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.086885 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.087096 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.087195 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.087403 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.087492 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.087702 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.088297 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.088520 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.088747 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.088845 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.089145 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.089240 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.089451 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.089697 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.089796 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.090050 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.090181 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.090377 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.090666 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.090755 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.090974 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.091072 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.091276 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.091375 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.091582 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.091681 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.091913 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.092044 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.092235 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.092331 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.092542 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.092641 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.092845 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.092935 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.093148 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.093238 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.093452 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.093552 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.093801 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.093898 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.094060 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.094182 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.094405 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.094509 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.094711 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.094801 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.095016 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.095111 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.095320 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.095412 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.095627 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.095716 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.095938 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.096026 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.096250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.096348 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.096562 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.096661 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.096871 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.096961 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.097179 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.097278 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.097499 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.097600 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.097808 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.097899 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.098140 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.098236 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.098463 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.098554 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.098792 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.098892 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.099085 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.099174 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.099419 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.099519 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.099730 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.100021 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.100125 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.100340 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.100612 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.100712 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.100976 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.101295 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.101613 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.101797 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.101930 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.102135 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.102272 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.102473 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.102599 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.102805 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.102902 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.103115 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.103222 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.103489 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.104070 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.104301 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.104400 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.104625 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.104726 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.104943 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.105041 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.105499 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.105595 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.105831 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.105922 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.106168 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.106261 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.106485 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.106575 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.106799 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.106891 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.107109 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.107199 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.107435 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.107525 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.107750 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.107848 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.108058 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.108147 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.108362 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.108463 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.108605 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:57:43.108736 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.108977 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.109309 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.109635 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.109946 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.110297 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.110623 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.110970 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.111281 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.111625 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.111955 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.112269 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.112579 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.112885 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 11:57:43.113124 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 11:57:43.261967 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO dbcounter [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Registered counter for database nova_api Sep 09 11:57:43.265785 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO dbcounter [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Registered counter for database nova_api Sep 09 11:57:43.283998 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_db.sqlalchemy.engines [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.285894 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_db.sqlalchemy.engines [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.290984 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writer thread running {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.292719 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writer thread running {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.349348 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.context [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0bbb56c1-39d5-497b-b58d-1536df774c9a(cell1) {{(pid=105686) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 11:57:43.351409 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.context [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0bbb56c1-39d5-497b-b58d-1536df774c9a(cell1) {{(pid=105687) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 11:57:43.353481 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_concurrency.lockutils [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 11:57:43.353957 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_concurrency.lockutils [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 11:57:43.355772 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 11:57:43.355883 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_concurrency.lockutils [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 11:57:43.356248 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 11:57:43.356530 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_concurrency.lockutils [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 11:57:43.356975 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_concurrency.lockutils [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 11:57:43.357823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 11:57:43.358601 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 11:57:43.358991 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_concurrency.lockutils [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 11:57:43.359108 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 11:57:43.360993 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO dbcounter [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Registered counter for database nova_cell0 Sep 09 11:57:43.361100 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 11:57:43.363074 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO dbcounter [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Registered counter for database nova_cell0 Sep 09 11:57:43.365046 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO dbcounter [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Registered counter for database nova_cell1 Sep 09 11:57:43.367108 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO dbcounter [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Registered counter for database nova_cell1 Sep 09 11:57:43.372364 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_db.sqlalchemy.engines [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.373652 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_db.sqlalchemy.engines [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.376184 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_db.sqlalchemy.engines [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.377368 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_db.sqlalchemy.engines [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.381464 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writer thread running {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.381809 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writer thread running {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.382905 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writer thread running {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.524823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writer thread running {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.531132 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO dbcounter [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Registered counter for database nova_cell0 Sep 09 11:57:43.535212 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO dbcounter [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Registered counter for database nova_cell0 Sep 09 11:57:43.538163 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG oslo_db.sqlalchemy.engines [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.543288 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writer thread running {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.544168 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_db.sqlalchemy.engines [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 11:57:43.548829 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writer thread running {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 11:57:43.890424 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: WARNING keystonemiddleware.auth_token [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 11:57:43.891105 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: WARNING keystonemiddleware.auth_token [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 11:57:43.897905 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: WARNING keystonemiddleware.auth_token [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 11:57:43.898041 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: WARNING keystonemiddleware.auth_token [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 11:57:44.246142 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: WARNING keystonemiddleware.auth_token [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 11:57:44.246410 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: WARNING keystonemiddleware.auth_token [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 11:57:44.252195 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: WARNING keystonemiddleware.auth_token [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 11:57:44.252330 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: WARNING keystonemiddleware.auth_token [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 11:57:44.257593 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a92fb59c0 pid: 105686 (default app) Sep 09 11:57:44.257703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a92fb59c0 pid: 105687 (default app) Sep 09 11:57:44.260272 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:57:44.261468 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-8a99c395-ff57-498c-b2fa-77fb02af69ae None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002278 Sep 09 11:57:44.261890 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Fri Sep 9 11:57:44 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:06.247662 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:06.249513 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002777 Sep 09 11:59:06.250094 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:06.263629 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_api:SELECT=3 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.264565 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_cell1:SELECT=3 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.265263 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_cell0:SELECT=3 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:06.267373 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:07.206882 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-6f26260b-c9e8-4e40-b723-8a498bad91c0 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:07.241405 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-6f26260b-c9e8-4e40-b723-8a498bad91c0 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.983895 Sep 09 11:59:07.242185 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 9 11:59:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:09.912503 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:09.913522 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-42a699f6-6708-4936-93c9-8f0ce52477b7 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 09 11:59:09.914085 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 2/4] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:10.399570 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-45c64e0a-5d7f-41f1-992b-bc37d8fb38db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "swap": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:10.448279 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-45c64e0a-5d7f-41f1-992b-bc37d8fb38db admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528034 Sep 09 11:59:10.448844 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 3/5] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:10.463605 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_api:SELECT=3 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:10.464583 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_cell0:SELECT=3 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:10.466836 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_cell1:SELECT=3 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:10.467677 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:10.676545 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-afc908da-121f-4bff-8afa-b90ac68c2308 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:10.745986 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-afc908da-121f-4bff-8afa-b90ac68c2308 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288743 Sep 09 11:59:10.746678 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 3/6] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 9 11:59:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 11:59:13.470059 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-45c64e0a-5d7f-41f1-992b-bc37d8fb38db admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:13.472124 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-45c64e0a-5d7f-41f1-992b-bc37d8fb38db admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002161 Sep 09 11:59:13.472633 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 4/7] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:14.190463 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-2ab2f2fc-cc2b-406b-943d-91bcc8c04208 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:14.238314 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-2ab2f2fc-cc2b-406b-943d-91bcc8c04208 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.757635 Sep 09 11:59:14.246977 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 4/8] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:14.252482 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-9a449ecf-4482-4b0b-ae2f-42401ac28b81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:14.304045 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-9a449ecf-4482-4b0b-ae2f-42401ac28b81 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051758 Sep 09 11:59:14.306155 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 5/9] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 9 11:59:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 11:59:16.965392 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-2ab2f2fc-cc2b-406b-943d-91bcc8c04208 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:16.966439 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-2ab2f2fc-cc2b-406b-943d-91bcc8c04208 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 09 11:59:16.967011 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:17.406783 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-c40c5188-3382-4c78-9585-6a8c7b0a71f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:17.426213 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-c40c5188-3382-4c78-9585-6a8c7b0a71f7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453040 Sep 09 11:59:17.427345 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 6/11] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:17.439698 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-004ae360-d6c6-4433-ab91-1b0d9275b230 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:17.467175 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-004ae360-d6c6-4433-ab91-1b0d9275b230 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031235 Sep 09 11:59:17.467763 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 6/12] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 9 11:59:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:20.121599 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-c40c5188-3382-4c78-9585-6a8c7b0a71f7 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:20.122767 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-c40c5188-3382-4c78-9585-6a8c7b0a71f7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 09 11:59:20.123405 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 7/13] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:20.565442 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-eb8c2266-0280-4b23-b256-3aabdddee798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "disk": 10}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:20.588608 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-eb8c2266-0280-4b23-b256-3aabdddee798 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459123 Sep 09 11:59:20.589169 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 7/14] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:20.602569 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-d01669b4-7c34-4b7c-a1c6-3e37ee59a997 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:20.631780 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-d01669b4-7c34-4b7c-a1c6-3e37ee59a997 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033483 Sep 09 11:59:20.632543 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 8/15] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 9 11:59:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 11:59:23.320708 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-eb8c2266-0280-4b23-b256-3aabdddee798 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:23.321734 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-eb8c2266-0280-4b23-b256-3aabdddee798 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 09 11:59:23.322214 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 8/16] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:23.829640 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-f1320270-9bad-4fe9-9697-955da8123200 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:23.851249 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-f1320270-9bad-4fe9-9697-955da8123200 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.522793 Sep 09 11:59:23.851835 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 9/17] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:23.864321 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-dfeaeb1b-44dc-4076-93bf-feee8972a8c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:23.891897 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-dfeaeb1b-44dc-4076-93bf-feee8972a8c9 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031179 Sep 09 11:59:23.892513 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 9/18] 10.222.0.62 () {64 vars in 1336 bytes} [Fri Sep 9 11:59:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:26.835381 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-f1320270-9bad-4fe9-9697-955da8123200 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:26.836500 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-f1320270-9bad-4fe9-9697-955da8123200 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Sep 09 11:59:26.836963 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 10/19] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:27.329076 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-b1310681-ef8e-4167-bf85-e13c9a133b76 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:27.364432 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-b1310681-ef8e-4167-bf85-e13c9a133b76 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.520606 Sep 09 11:59:27.366227 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 10/20] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 9 11:59:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 11:59:30.127690 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-f1320270-9bad-4fe9-9697-955da8123200 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:30.128694 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-f1320270-9bad-4fe9-9697-955da8123200 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 09 11:59:30.129100 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 11/21] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 11:59:30.550467 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-295493b8-5bc0-4e92-86ec-1a3cbad05b74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "name": "m1.tiny", "ram": 512, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:30.572430 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-295493b8-5bc0-4e92-86ec-1a3cbad05b74 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.436589 Sep 09 11:59:30.572988 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 11/22] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:30.585001 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-ad719254-adb6-43c5-8b89-798bb231a741 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:30.614574 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-ad719254-adb6-43c5-8b89-798bb231a741 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033173 Sep 09 11:59:30.615703 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 12/23] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 9 11:59:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:33.320017 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-295493b8-5bc0-4e92-86ec-1a3cbad05b74 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:33.321123 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-295493b8-5bc0-4e92-86ec-1a3cbad05b74 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 09 11:59:33.321611 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:33.763416 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-3fd70dac-7970-4106-a25e-f87317b9e0fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:33.788200 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-3fd70dac-7970-4106-a25e-f87317b9e0fe admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459585 Sep 09 11:59:33.789235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 13/25] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:33.801767 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-0cca02d5-41c2-4cb9-99fd-52d32f87510c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:33.826323 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-0cca02d5-41c2-4cb9-99fd-52d32f87510c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028616 Sep 09 11:59:33.827104 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 13/26] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 9 11:59:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 11:59:36.481201 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-3fd70dac-7970-4106-a25e-f87317b9e0fe admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:36.482856 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-3fd70dac-7970-4106-a25e-f87317b9e0fe admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002337 Sep 09 11:59:36.483266 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 14/27] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:37.041547 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-15f5f80c-7f16-4e50-9b0a-17fb7ff44ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "swap": 0, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:37.061839 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-15f5f80c-7f16-4e50-9b0a-17fb7ff44ea4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.572291 Sep 09 11:59:37.062432 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 14/28] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:37.075182 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-ca28242b-78ca-4ea3-807e-4874bc682520 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:37.080206 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:37.112227 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-ca28242b-78ca-4ea3-807e-4874bc682520 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040431 Sep 09 11:59:37.113558 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 15/29] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 9 11:59:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:39.831216 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-15f5f80c-7f16-4e50-9b0a-17fb7ff44ea4 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:39.832218 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-15f5f80c-7f16-4e50-9b0a-17fb7ff44ea4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Sep 09 11:59:39.832836 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 15/30] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:40.311003 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-644ea9c5-873a-4c68-a67e-9fd2f69cb015 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:40.330683 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-644ea9c5-873a-4c68-a67e-9fd2f69cb015 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491250 Sep 09 11:59:40.331769 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 16/31] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 11:59:40.344581 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-0c063729-c730-4cdb-bddb-bc6a4b870039 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:40.369674 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-0c063729-c730-4cdb-bddb-bc6a4b870039 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028809 Sep 09 11:59:40.370440 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 16/32] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 9 11:59:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:43.001359 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-644ea9c5-873a-4c68-a67e-9fd2f69cb015 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:43.002560 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-644ea9c5-873a-4c68-a67e-9fd2f69cb015 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 09 11:59:43.002966 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 17/33] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:43.458180 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-a2a64384-c991-4dd0-910d-b264f5987447 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "id": "5", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:43.468010 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 11:59:43.485871 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-a2a64384-c991-4dd0-910d-b264f5987447 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.476882 Sep 09 11:59:43.486965 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 17/34] 10.222.0.62 () {64 vars in 1283 bytes} [Fri Sep 9 11:59:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 11:59:43.499246 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-fbd77571-3d0a-4657-95cc-5b19bdb53437 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 11:59:43.526994 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-fbd77571-3d0a-4657-95cc-5b19bdb53437 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031423 Sep 09 11:59:43.527658 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 18/35] 10.222.0.62 () {64 vars in 1333 bytes} [Fri Sep 9 11:59:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 11:59:59.629958 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-a2a64384-c991-4dd0-910d-b264f5987447 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 11:59:59.631013 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-a2a64384-c991-4dd0-910d-b264f5987447 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 09 11:59:59.631930 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 18/36] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 11:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 11:59:59.642301 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:00:00.031183 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-c26061a9-fc74-47f0-a0c3-a1f5933e883d admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:00.049704 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-c26061a9-fc74-47f0-a0c3-a1f5933e883d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411834 Sep 09 12:00:00.050253 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 19/37] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 9 11:59:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:00:01.359535 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-a2a64384-c991-4dd0-910d-b264f5987447 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:01.360532 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-a2a64384-c991-4dd0-910d-b264f5987447 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 09 12:00:01.360928 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 19/38] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:01.889318 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-d1946f4d-637a-448e-bf41-ff3969fc59c9 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:01.894695 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.wsgi [None req-d1946f4d-637a-448e-bf41-ff3969fc59c9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-d1946f4d-637a-448e-bf41-ff3969fc59c9 admin admin] Request method failure captured: Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Accept: application/json Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Accept-Encoding: gzip, deflate Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Connection: keep-alive Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Content-Length: 0 Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Host: 10.222.0.62 Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Openstack-Api-Version: compute 2.92 Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Openstack-System-Scope: None Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: User-Agent: python-novaclient Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Auth-Token: gAAAAABjGyrBhdj0A08VfZTyXI_cuQnIKBVZTYExaZyCNp78-5vQNOzGcrUWuLK7cfZ7Quw4_8zzpf3PVe0ui-ho9sz2OmWaDAD_NMobNaB0cBLir9fXKYru7rXUFU80z7dG8Wd6bdzbD09uiOJV18_WoUwpprRx6gUTxwbF3yQ4JObJdV5imic Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Domain-Id: None Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Domain-Name: None Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Identity-Status: Confirmed Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Is-Admin-Project: True Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Domain-Id: default Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Domain-Name: Default Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Name: admin Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Role: member,reader,admin Sep 09 12:00:01.898493 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Roles: member,reader,admin Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fe7d1fa6c42548518e72832336a573e5"}]}] Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant: admin Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant-Name: admin Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User: admin Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Domain-Id: default Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Domain-Name: Default Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Id: 5c92b48d12534a97833b0661f5d186ee Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Name: admin Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: method: > Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: exception: Flavor 42 could not be found. Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: action_args: {'id': '42'} Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:00:01.900235 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:01.901250 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.902647 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-d1946f4d-637a-448e-bf41-ff3969fc59c9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:00:01.903963 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-d1946f4d-637a-448e-bf41-ff3969fc59c9 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399762 Sep 09 12:00:01.903963 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 20/39] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 9 12:00:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:00:01.910017 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-009dfb91-57c9-4670-a115-63e96fbd9904 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:01.933209 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-009dfb91-57c9-4670-a115-63e96fbd9904 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026794 Sep 09 12:00:01.933779 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 9 12:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:00:01.944610 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-8b8bbe1a-2636-4488-92a2-9366a4777c30 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:01.967059 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-8b8bbe1a-2636-4488-92a2-9366a4777c30 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027065 Sep 09 12:00:01.967697 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 21/41] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 9 12:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:00:01.977886 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-709dee8c-40c9-4748-a1a9-94cc16a80125 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:01.983513 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.wsgi [None req-709dee8c-40c9-4748-a1a9-94cc16a80125 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-709dee8c-40c9-4748-a1a9-94cc16a80125 admin admin] Request method failure captured: Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Accept: application/json Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Accept-Encoding: gzip, deflate Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Connection: keep-alive Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Content-Length: 0 Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Host: 10.222.0.62 Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Openstack-Api-Version: compute 2.92 Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Openstack-System-Scope: None Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: User-Agent: python-novaclient Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Auth-Token: gAAAAABjGyrBhdj0A08VfZTyXI_cuQnIKBVZTYExaZyCNp78-5vQNOzGcrUWuLK7cfZ7Quw4_8zzpf3PVe0ui-ho9sz2OmWaDAD_NMobNaB0cBLir9fXKYru7rXUFU80z7dG8Wd6bdzbD09uiOJV18_WoUwpprRx6gUTxwbF3yQ4JObJdV5imic Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Domain-Id: None Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Domain-Name: None Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Identity-Status: Confirmed Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Is-Admin-Project: True Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Domain-Id: default Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Domain-Name: Default Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Name: admin Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Role: member,reader,admin Sep 09 12:00:01.986823 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Roles: member,reader,admin Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fe7d1fa6c42548518e72832336a573e5"}]}] Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant: admin Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant-Name: admin Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User: admin Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Domain-Id: default Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Domain-Name: Default Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Id: 5c92b48d12534a97833b0661f5d186ee Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Name: admin Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: method: > Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: exception: Flavor 42 could not be found. Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: action_args: {'id': '42'} Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:00:01.988389 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:01.993737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:01.995122 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-709dee8c-40c9-4748-a1a9-94cc16a80125 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:00:01.996385 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-709dee8c-40c9-4748-a1a9-94cc16a80125 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014605 Sep 09 12:00:01.996385 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 21/42] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 9 12:00:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:00:03.222580 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-8b8bbe1a-2636-4488-92a2-9366a4777c30 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:03.223598 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-8b8bbe1a-2636-4488-92a2-9366a4777c30 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 09 12:00:03.224030 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 22/43] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:03.773817 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-bb25ff7b-0f15-4e6f-a0fd-c6db7718ba3b admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:03.778886 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.wsgi [None req-bb25ff7b-0f15-4e6f-a0fd-c6db7718ba3b admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-bb25ff7b-0f15-4e6f-a0fd-c6db7718ba3b admin admin] Request method failure captured: Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Accept: application/json Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Accept-Encoding: gzip, deflate Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Connection: keep-alive Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Content-Length: 0 Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Host: 10.222.0.62 Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Openstack-Api-Version: compute 2.92 Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Openstack-System-Scope: None Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: User-Agent: python-novaclient Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Auth-Token: gAAAAABjGyrDkv7bfRdCA_tehME8xGdFbP-f_sbyI8HnbUxoKxjj0vmOll0urSa4lIrIwyJLNIZS_OIlMZEbfqWdxXO66Ag9_r_huhu1rYmHEoi6an-y4qV7DG-DzwWNlVjLtk3mcsvQiSb7ba8eP_jF3_HxXuB9j4CqkOcEe9QdMGd_an8FKXU Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Domain-Id: None Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Domain-Name: None Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Identity-Status: Confirmed Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Is-Admin-Project: True Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Domain-Id: default Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Domain-Name: Default Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Name: admin Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Role: member,reader,admin Sep 09 12:00:03.780382 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Roles: member,reader,admin Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fe7d1fa6c42548518e72832336a573e5"}]}] Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant: admin Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant-Name: admin Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User: admin Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Domain-Id: default Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Domain-Name: Default Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Id: 5c92b48d12534a97833b0661f5d186ee Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Name: admin Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: method: > Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: exception: Flavor 84 could not be found. Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: action_args: {'id': '84'} Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:00:03.781910 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:03.782968 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.784551 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-bb25ff7b-0f15-4e6f-a0fd-c6db7718ba3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:00:03.785911 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-bb25ff7b-0f15-4e6f-a0fd-c6db7718ba3b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.404647 Sep 09 12:00:03.785911 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 9 12:00:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:00:03.792115 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-ac013bf4-2c26-4710-b376-77ebd3a0d68f admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:03.806917 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-ac013bf4-2c26-4710-b376-77ebd3a0d68f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018923 Sep 09 12:00:03.807470 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 23/45] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 9 12:00:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:00:03.817001 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-d8658ed2-16b0-45a6-89b0-26424b7abca6 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:03.832686 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-d8658ed2-16b0-45a6-89b0-26424b7abca6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019262 Sep 09 12:00:03.833214 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 23/46] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 9 12:00:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:00:03.843247 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-e958c9e2-438a-4917-8717-7a2639658f86 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:03.848327 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.wsgi [None req-e958c9e2-438a-4917-8717-7a2639658f86 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-e958c9e2-438a-4917-8717-7a2639658f86 admin admin] Request method failure captured: Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Accept: application/json Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Accept-Encoding: gzip, deflate Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Connection: keep-alive Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Content-Length: 0 Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Host: 10.222.0.62 Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Openstack-Api-Version: compute 2.92 Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Openstack-System-Scope: None Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: User-Agent: python-novaclient Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Auth-Token: gAAAAABjGyrDkv7bfRdCA_tehME8xGdFbP-f_sbyI8HnbUxoKxjj0vmOll0urSa4lIrIwyJLNIZS_OIlMZEbfqWdxXO66Ag9_r_huhu1rYmHEoi6an-y4qV7DG-DzwWNlVjLtk3mcsvQiSb7ba8eP_jF3_HxXuB9j4CqkOcEe9QdMGd_an8FKXU Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Domain-Id: None Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Domain-Name: None Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Identity-Status: Confirmed Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Is-Admin-Project: True Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Domain-Id: default Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Domain-Name: Default Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Name: admin Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Role: member,reader,admin Sep 09 12:00:03.849820 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Roles: member,reader,admin Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fe7d1fa6c42548518e72832336a573e5"}]}] Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant: admin Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant-Name: admin Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User: admin Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Domain-Id: default Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Domain-Name: Default Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Id: 5c92b48d12534a97833b0661f5d186ee Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Name: admin Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: method: > Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: exception: Flavor 84 could not be found. Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: action_args: {'id': '84'} Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:00:03.851483 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:03.852708 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:03.854072 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-e958c9e2-438a-4917-8717-7a2639658f86 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:00:03.855442 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-e958c9e2-438a-4917-8717-7a2639658f86 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011529 Sep 09 12:00:03.855442 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 24/47] 10.222.0.62 () {60 vars in 1190 bytes} [Fri Sep 9 12:00:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:00:05.101363 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-d8658ed2-16b0-45a6-89b0-26424b7abca6 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:05.102380 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-d8658ed2-16b0-45a6-89b0-26424b7abca6 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Sep 09 12:00:05.102770 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 24/48] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:05.638018 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-9b9f3b80-1fba-4263-9c64-64ff5030ffbf admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:05.643891 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.wsgi [None req-9b9f3b80-1fba-4263-9c64-64ff5030ffbf admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-9b9f3b80-1fba-4263-9c64-64ff5030ffbf admin admin] Request method failure captured: Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Accept: application/json Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Accept-Encoding: gzip, deflate Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Connection: keep-alive Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Content-Length: 0 Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Host: 10.222.0.62 Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Openstack-Api-Version: compute 2.92 Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Openstack-System-Scope: None Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: User-Agent: python-novaclient Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Auth-Token: gAAAAABjGyrEtr2MHaBuQpruHw4oBhA_7x4XEwQv_lhm4ZUN1lKv8JNOKpsm6KFChb27eJZIpQ9BamyTQRJzF_lyyOJ-0bFXizbLUgLNKGdNBqUFH-KbH_IqZRZ5fku013BgVsfF6uKK4wNIFlmQOcQ1fum237YqEJhsJI-EAKnWo324z4cJH_Y Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Domain-Id: None Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Domain-Name: None Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Identity-Status: Confirmed Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Is-Admin-Project: True Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Domain-Id: default Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Domain-Name: Default Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Project-Name: admin Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Role: member,reader,admin Sep 09 12:00:05.645395 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Roles: member,reader,admin Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fe7d1fa6c42548518e72832336a573e5"}]}] Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant: admin Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-Tenant-Name: admin Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User: admin Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Domain-Id: default Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Domain-Name: Default Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Id: 5c92b48d12534a97833b0661f5d186ee Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: X-User-Name: admin Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: method: > Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: exception: Flavor 451 could not be found. Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: action_args: {'id': '451'} Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:00:05.646987 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:05.647946 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.649538 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-9b9f3b80-1fba-4263-9c64-64ff5030ffbf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:00:05.650903 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-9b9f3b80-1fba-4263-9c64-64ff5030ffbf admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.407040 Sep 09 12:00:05.650903 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 25/49] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 9 12:00:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:00:05.656692 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-105edfdc-f25d-4ab9-beea-f42614db069e admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:05.671403 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-105edfdc-f25d-4ab9-beea-f42614db069e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018295 Sep 09 12:00:05.671932 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 25/50] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 9 12:00:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:00:05.681693 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:05.697109 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019436 Sep 09 12:00:05.697636 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 26/51] 10.222.0.62 () {60 vars in 1210 bytes} [Fri Sep 9 12:00:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:00:05.706708 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-a1b71d27-f2e6-4410-8b26-ebea3ec9f905 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:05.711630 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.wsgi [None req-a1b71d27-f2e6-4410-8b26-ebea3ec9f905 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-a1b71d27-f2e6-4410-8b26-ebea3ec9f905 admin admin] Request method failure captured: Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Accept: application/json Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Accept-Encoding: gzip, deflate Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Connection: keep-alive Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Content-Length: 0 Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Host: 10.222.0.62 Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Openstack-Api-Version: compute 2.92 Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Openstack-System-Scope: None Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: User-Agent: python-novaclient Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Auth-Token: gAAAAABjGyrEtr2MHaBuQpruHw4oBhA_7x4XEwQv_lhm4ZUN1lKv8JNOKpsm6KFChb27eJZIpQ9BamyTQRJzF_lyyOJ-0bFXizbLUgLNKGdNBqUFH-KbH_IqZRZ5fku013BgVsfF6uKK4wNIFlmQOcQ1fum237YqEJhsJI-EAKnWo324z4cJH_Y Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Domain-Id: None Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Domain-Name: None Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Identity-Status: Confirmed Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Is-Admin-Project: True Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Openstack-Nova-Api-Version: 2.92 Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Domain-Id: default Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Domain-Name: Default Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Project-Name: admin Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Role: member,reader,admin Sep 09 12:00:05.713110 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Roles: member,reader,admin Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/fe7d1fa6c42548518e72832336a573e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/fe7d1fa6c42548518e72832336a573e5"}]}] Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant: admin Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant-Id: fe7d1fa6c42548518e72832336a573e5 Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-Tenant-Name: admin Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User: admin Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Domain-Id: default Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Domain-Name: Default Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Id: 5c92b48d12534a97833b0661f5d186ee Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: X-User-Name: admin Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: method: > Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: exception: Flavor 451 could not be found. Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: action_args: {'id': '451'} Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:00:05.714731 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:05.715703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: ERROR nova.api.openstack.wsgi Sep 09 12:00:05.717067 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-a1b71d27-f2e6-4410-8b26-ebea3ec9f905 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:00:05.718411 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-a1b71d27-f2e6-4410-8b26-ebea3ec9f905 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011215 Sep 09 12:00:05.718411 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 26/52] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 9 12:00:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 09 12:00:06.942822 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:06.943635 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 09 12:00:06.944046 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 27/53] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:07.475119 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-5d151ba8-a32a-4176-8101-9e3350507600 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:00:07.495496 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-5d151ba8-a32a-4176-8101-9e3350507600 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.412510 Sep 09 12:00:07.496053 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 27/54] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 9 12:00:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:08.753537 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:08.754568 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 09 12:00:08.754963 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:09.278173 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-1dad576f-085a-4b1d-9173-a3454d5e9251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:00:09.297781 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-1dad576f-085a-4b1d-9173-a3454d5e9251 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.407638 Sep 09 12:00:09.298362 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 28/56] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 9 12:00:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:10.535744 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:10.536732 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 09 12:00:10.537129 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 29/57] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:11.065859 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-5c55b08a-1fb5-4b33-b63c-905146d23eaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:00:11.084481 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-5c55b08a-1fb5-4b33-b63c-905146d23eaa admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.410815 Sep 09 12:00:11.085045 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 29/58] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 9 12:00:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:00:12.300844 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:12.301879 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 09 12:00:12.302313 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 30/59] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:12.827888 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-7f040bf6-6140-4367-9138-4ca814bb0468 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:00:12.846596 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-7f040bf6-6140-4367-9138-4ca814bb0468 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.408386 Sep 09 12:00:12.847144 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 30/60] 10.222.0.62 () {64 vars in 1235 bytes} [Fri Sep 9 12:00:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:00:14.079914 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:14.080924 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 09 12:00:14.081350 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 31/61] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:00:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:00:14.601128 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-553efa78-fe8b-4be8-a690-4bd7882b7b75 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:00:14.624558 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-553efa78-fe8b-4be8-a690-4bd7882b7b75 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405983 Sep 09 12:00:14.625105 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 31/62] 10.222.0.62 () {60 vars in 1202 bytes} [Fri Sep 9 12:00:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:01:11.991823 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:01:11.992835 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-29c320ec-4ecb-47fe-9739-0985deb16c92 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 09 12:01:11.993237 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 32/63] 10.222.0.62 () {54 vars in 931 bytes} [Fri Sep 9 12:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:01:12.004151 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:12.388562 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-ba7a7ece-8557-42a1-9583-dd5e1f4710fe admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:01:12.409199 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-ba7a7ece-8557-42a1-9583-dd5e1f4710fe admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409724 Sep 09 12:01:12.409659 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 32/64] 10.222.0.62 () {60 vars in 1292 bytes} [Fri Sep 9 12:01:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:01:12.431744 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_api:SELECT=14 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:01:12.435701 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-512ab48a-dc79-4adf-88c0-fa0a288d2916 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:01:12.443096 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-512ab48a-dc79-4adf-88c0-fa0a288d2916 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013388 Sep 09 12:01:12.443622 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 33/65] 10.222.0.62 () {60 vars in 1283 bytes} [Fri Sep 9 12:01:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:01:12.455142 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-0257485a-8e91-4da1-8f1b-c6dab9d50d39 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:01:12.462365 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-0257485a-8e91-4da1-8f1b-c6dab9d50d39 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010743 Sep 09 12:01:12.462881 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 33/66] 10.222.0.62 () {60 vars in 1286 bytes} [Fri Sep 9 12:01:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:01:12.474095 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:01:12.481823 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011219 Sep 09 12:01:12.482383 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 34/67] 10.222.0.62 () {60 vars in 1286 bytes} [Fri Sep 9 12:01:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:01:12.494423 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-af97f4a5-e62c-4c83-884a-fe5d37ee1a9e admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:01:12.501593 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-af97f4a5-e62c-4c83-884a-fe5d37ee1a9e admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011284 Sep 09 12:01:12.502105 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 34/68] 10.222.0.62 () {60 vars in 1283 bytes} [Fri Sep 9 12:01:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:04:09.598408 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:09.599471 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 09 12:04:09.599862 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 35/69] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:04:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:04:09.744669 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_api:SELECT=6 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:04:09.910965 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:09.915717 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:09.916189 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:09.916617 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:09.917333 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:09.917779 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:09.918222 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:09.950152 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-c9671204-1ccd-43e1-84e3-a11367b4414f admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.207024 Sep 09 12:04:09.950707 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 35/70] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 9 12:04:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:04:11.062081 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:11.063173 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 09 12:04:11.063669 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 36/71] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:04:11.258092 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:11.262063 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:11.262567 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:11.262999 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:11.263717 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:11.264167 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:11.264590 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:11.284486 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-037a4b4a-878e-4c9a-980d-019c701c0294 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.078792 Sep 09 12:04:11.284970 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 36/72] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 9 12:04:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:04:22.768697 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:22.769990 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 09 12:04:22.770376 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:04:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:04:22.913323 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_cell0:SELECT=4 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:04:22.914048 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_cell1:SELECT=4 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:04:22.914770 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG dbcounter [-] [105687] Writing DB stats nova_api:SELECT=8 {{(pid=105687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:04:22.962801 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:22.966229 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:22.966707 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:22.967137 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:22.967854 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:22.968305 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:22.968723 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:22.995010 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-a9107e55-f13d-4edf-994d-2cd9ad01574d admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.085837 Sep 09 12:04:22.995737 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 37/74] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 9 12:04:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:04:24.066825 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG nova.api.openstack.wsgi [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] Calling method '>' {{(pid=105686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:24.067826 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: INFO nova.api.openstack.requestlog [None req-5380a2b8-da27-4d27-bc4d-1f925de04a26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 09 12:04:24.068225 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: [pid: 105686|app: 0|req: 38/75] 10.222.0.62 () {56 vars in 1074 bytes} [Fri Sep 9 12:04:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:04:24.260345 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG nova.api.openstack.wsgi [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] Calling method '>' {{(pid=105687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:04:24.263923 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:24.264343 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:24.264780 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:24.265623 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:04:24.265985 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:04:24.266442 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: DEBUG oslo_concurrency.lockutils [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:04:24.288525 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: INFO nova.api.openstack.requestlog [None req-f77c1ed5-40a4-44c6-933a-1e892407c7a7 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.080748 Sep 09 12:04:24.289089 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: [pid: 105687|app: 0|req: 38/76] 10.222.0.62 () {60 vars in 1193 bytes} [Fri Sep 9 12:04:24 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:05:23.326326 dv-cinder-852210-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 09 12:05:23.326874 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: Fri Sep 9 12:05:23 2022 - graceful shutdown triggered... Sep 09 12:05:23.327335 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: Gracefully killing worker 1 (pid: 105686)... Sep 09 12:05:23.327703 dv-cinder-852210-13-iscsi devstack@n-api.service[105687]: Gracefully killing worker 2 (pid: 105687)... Sep 09 12:05:23.454721 dv-cinder-852210-13-iscsi devstack@n-api.service[105686]: DEBUG dbcounter [-] [105686] Writing DB stats nova_api:SELECT=4 {{(pid=105686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:05:24.327274 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: worker 1 buried after 1 seconds Sep 09 12:05:24.327274 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: worker 2 buried after 1 seconds Sep 09 12:05:24.327274 dv-cinder-852210-13-iscsi devstack@n-api.service[105685]: goodbye to uWSGI. Sep 09 12:05:24.328824 dv-cinder-852210-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 09 12:05:24.329367 dv-cinder-852210-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 09 12:05:24.332207 dv-cinder-852210-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 09 12:05:24.341876 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 09 12:05:24.344498 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 12:05:24 2022] *** Sep 09 12:05:24.344661 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 12:05:24.344798 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 12:05:24.344926 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: nodename: dv-cinder-852210-13-iscsi Sep 09 12:05:24.345043 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: machine: x86_64 Sep 09 12:05:24.345172 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: clock source: unix Sep 09 12:05:24.345293 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: pcre jit disabled Sep 09 12:05:24.345407 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: detected number of CPU cores: 4 Sep 09 12:05:24.345519 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: current working directory: / Sep 09 12:05:24.345638 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: detected binary path: /usr/bin/uwsgi-core Sep 09 12:05:24.345758 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: your processes number limit is 47680 Sep 09 12:05:24.345874 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: your memory page size is 4096 bytes Sep 09 12:05:24.345988 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: detected max file descriptor number: 2048 Sep 09 12:05:24.346136 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: lock engine: pthread robust mutexes Sep 09 12:05:24.347029 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: thunder lock: enabled Sep 09 12:05:24.347363 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 09 12:05:24.347550 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 12:05:24.388331 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: Python main interpreter initialized at 0x5610db5c59c0 Sep 09 12:05:24.388331 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: python threads support enabled Sep 09 12:05:24.388331 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: your server socket listen backlog is limited to 100 connections Sep 09 12:05:24.388331 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: your mercy for graceful operations on workers is 90 seconds Sep 09 12:05:24.388905 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 12:05:24.388905 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: *** Operational MODE: preforking *** Sep 09 12:05:24.389071 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: *** uWSGI is running in multiple interpreter mode *** Sep 09 12:05:24.389071 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: spawned uWSGI master process (pid: 120707) Sep 09 12:05:24.389246 dv-cinder-852210-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 09 12:05:24.389982 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: spawned uWSGI worker 1 (pid: 120719, cores: 1) Sep 09 12:05:24.391794 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: spawned uWSGI worker 2 (pid: 120720, cores: 1) Sep 09 12:05:24.391794 dv-cinder-852210-13-iscsi devstack@n-api.service[120707]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 12:05:25.053213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:05:25.055564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 09 12:05:26.215694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:05:26.215694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: from cryptography.utils import int_from_bytes Sep 09 12:05:26.216248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:05:26.216248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: from cryptography.utils import int_from_bytes Sep 09 12:05:26.223769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:05:26.223769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Sep 09 12:05:26.223769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 12:05:26.223769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: from cryptography.utils import int_from_bytes Sep 09 12:05:28.658102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:05:28.658709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:05:28.659003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:05:28.659372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:05:28.659628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:05:28.660024 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.660357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.660680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.661003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.661367 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.661701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.662009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.662411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.662754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.663016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.663331 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.663820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-13-iscsi {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.664153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.664467 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.664790 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.665117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.665425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.665750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.666071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.666606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.668695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.668695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.668695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.668695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.669016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.669222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.669484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.669801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.670142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.670470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.670865 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-13-iscsi {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.671178 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.671489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.671806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.672225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.672550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.672864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.673185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.673437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 12:05:28.673893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.673980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 12:05:28.674060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.674330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.674442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 12:05:28.674527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.674612 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 12:05:28.674829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.674945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 12:05:28.675137 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.675238 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.675418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.675594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.675723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.675899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.676016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.676205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.676421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.676627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.676763 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.676849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.677058 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.677146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.677228 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.677428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.677592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.677749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.677904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.678089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.678287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.678443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.678613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.678613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.678917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-13-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.679071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.679233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.679419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.679614 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.679770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.679946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.680105 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.680259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.680405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.680588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.680740 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.680913 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.681072 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.681220 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.681366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.681366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.681667 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.681889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.682044 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.682235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.682412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.682566 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.682714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.682885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.683047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.683202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.683368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.683515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.683661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.683816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.683971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.684136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.684304 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.684458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.684607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.684761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.684909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.685729 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.685890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-13-iscsi {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.686039 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.686226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.686389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.686552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.686708 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.687738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.687977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.687977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.688280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.688451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.688614 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.688773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.688945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.689094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.689249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.689398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.689545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.689699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.689873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.690021 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.690397 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.690578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.690729 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.690877 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.691034 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.691190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.691190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.691479 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.691634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.691794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.692001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.692169 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.692938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.693109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.693261 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.693424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.693581 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.693739 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.693894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.694048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.694231 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.694391 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.694547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.694703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.694861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.695016 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.695202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.696169 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.696331 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.696487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.696650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.696806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.696806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.697100 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.697100 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.697398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.697548 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.697695 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.697862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.698018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.698212 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.698600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.698771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.698929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.699078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.699231 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.699392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.699549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.699873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700030 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700177 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700713 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.700967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701061 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701346 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701432 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701524 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.701887 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702007 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702103 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702404 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702489 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702585 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702684 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.702973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703429 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703701 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703803 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703889 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.703983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704591 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.704951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.705112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.705208 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.705303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.705389 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.705629 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.706008 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.706145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.706235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.706337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.706427 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.706519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.706613 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.706707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.706803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.706903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.706996 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.707090 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.707182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.707536 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.707652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.707742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.707835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.707934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.708033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.708128 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.708228 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.708321 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.708415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.708511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.708604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.708701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.708797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.708894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.708981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.709073 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.709172 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.709259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.709343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.709435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.709529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.709624 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.709721 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.709816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.709911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.710004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.710099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.710267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.710367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.710592 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.710695 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.710928 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.711031 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.711241 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.711343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.711546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.711640 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.711867 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.711975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.712170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.712264 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.712479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.712573 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.712791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.712961 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.713097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.713191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.713406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.713514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.713712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.713808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.714018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.714145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.714878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.715024 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.715191 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.715352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.715500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.715670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.715827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.715986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.716099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.716301 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.716432 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.716617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.716734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.716926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.717022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.717265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.717362 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.717586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.717701 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.717906 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 12:05:28.718011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.718246 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.718371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.718560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.718657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.718880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.718985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.719193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.719303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.719504 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.719607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.719817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.719922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.720122 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.720235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.720427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.720532 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.720731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.720838 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.721753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.721869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.721961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722239 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722397 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722477 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722630 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.722924 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.723010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.723236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.723328 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.723548 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.723638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.723858 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.723947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.724165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.724255 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.724477 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.724569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.724787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.724879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.725092 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.725182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.725408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.725498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.725729 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726355 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726451 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726645 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.726968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.727074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.727278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.727382 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.727553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.727638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.727864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.727971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.728172 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.728279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.728482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.728586 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.728807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.728957 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.729120 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.729242 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.729433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.729553 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.729770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.729948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.730674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.730771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.730986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.731090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.731299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.731406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.731617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.731759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.731932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.732036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.732235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.732367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.732544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.732630 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.732850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.732955 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.733153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.733254 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.733456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.733561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.733764 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.733860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.734067 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.734206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.734396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.734499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.734699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.734808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.735002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.735104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.735305 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.735400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.735611 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.735714 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.735918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.736007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.736223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.736325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.736524 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.736635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.736825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.736929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.737163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.737281 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.737478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.737595 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.737795 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.737897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.738131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.738237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.738445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.738543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.738760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.738864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.739068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.739162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.739381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.739484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.739688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.739783 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.739998 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.740133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.740294 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.740394 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.740605 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.740734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.740918 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.741013 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.741235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.741330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.741541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.741646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.741852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.741958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.742218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.742322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.742504 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.742598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.742815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.742919 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.743117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.743210 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.743428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.743529 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.743755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.743865 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.744330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.744432 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.744644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.744746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.744963 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.745066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.745274 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.745370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.745614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.745721 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.745925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.746035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.746275 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.746371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.746591 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.746711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.746893 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.746998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.747209 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.747452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748210 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748676 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.748964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749147 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749232 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749567 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749672 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.749967 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.750221 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.750337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.750538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.750681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.750845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.750948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.751151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.751259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.751459 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.751554 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.751767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.751859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.752077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.752189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.752384 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.752478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.752691 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.752788 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.753001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.753146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.753315 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.753418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.753637 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.753740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.754615 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.754735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.754821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.754896 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.754974 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755129 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755204 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755274 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.755859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.756053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.756184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.756362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.756500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.756684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.756830 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.757006 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.757147 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.757309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.758572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.758678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.758678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.758838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.758838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.758981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759066 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759535 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759729 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759913 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.759987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.760078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.760160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.760336 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.760440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.760653 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.760759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.760970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.761094 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.761315 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.761551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.761658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.761918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.762024 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.762303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.762428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.762623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.762779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.762976 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.763082 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.763286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.763536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.763618 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.763932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.764072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.764270 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.764573 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.764726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.764885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.765197 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.765298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.765510 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.765817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.765919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.766186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.766469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.766576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.767063 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.767172 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.767397 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.769922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770245 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770898 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.770979 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771305 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771483 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771757 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.771847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772369 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.772735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.773039 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.773203 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.773450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.773695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.773939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.774252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.774353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.774441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.774516 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.774590 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.774710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.774806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.775015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.775108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.775339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.775431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.775650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.775763 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.775979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.776086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.776256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.776382 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.777487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.777664 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.777815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.777977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.778172 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.778352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.778533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.778694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.778885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.779044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.779206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.779366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.779567 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.779718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.779838 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.779919 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780240 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780611 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.780965 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.781107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.781213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.781468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.781701 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.781803 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.782077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.782360 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.782460 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.782711 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.782977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.783081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.783313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.783578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.783675 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.783916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.784079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.784363 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.784553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.784759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.784928 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.785104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.785323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.785323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.785983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.786176 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.786276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.786361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.786450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787389 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787467 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787775 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.787970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788114 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788268 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788351 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.788892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.789052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.789187 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.789366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.789544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.789701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.789835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.789973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.790165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.790312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.790472 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.790577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.790660 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.790931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.791039 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.791161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.791258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.791475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.791576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.791794 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.791889 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.792122 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.792221 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.792506 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.792604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.792816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.792901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.793119 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.793216 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.793449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.793538 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.793761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.793857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.794035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.794155 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.794376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.794471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.794638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.794724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.794983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.795080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.795387 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.795486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.795592 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.795731 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.795843 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.795938 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.796159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.796333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.796438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.796528 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.796749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.796848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.797050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.797156 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.797401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.797624 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.797738 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.797835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.798040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.798237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.798374 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.798487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.798691 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.798786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.799013 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.799102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.799375 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.799492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.799632 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.799733 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.799946 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.800055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.800253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.800583 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.800691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.800790 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.800888 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.800983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.801166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.801303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.801461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.801557 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.801761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.801856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.802071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.802279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.802417 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.802522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.802729 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.802841 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.803037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.803143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.803435 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.803558 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.803648 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.803743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.803984 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.804092 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.804272 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.804402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805376 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805690 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.805970 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.806066 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.806445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.806539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.806639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.806746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.806836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.806918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.807004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.807098 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.807275 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.807377 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.807583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.807680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.807897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.808512 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.808724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.808829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.809029 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.809132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.809349 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.809444 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.809658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.809816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.809973 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.810070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.810308 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.810404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.810618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.810727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.810924 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.811027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.811227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.811371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.811539 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.811689 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.811869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.812013 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.812190 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.812321 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.812500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.812638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.812812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.812951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.813121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.813270 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.813431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.813584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.813736 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.813883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.814047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.814332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.814431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.814748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.814853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.814944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.815279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.815392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.815484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.815571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.815665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.815847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.815961 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.816155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.816251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.816464 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.816560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.816771 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.816873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.817075 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.817170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.817383 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.817499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.817705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.817871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.818011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.818140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.818360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.818465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.818704 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.818813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.819027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.819122 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.819341 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.819438 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.819656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.819762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.819981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.820086 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.820290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.820395 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.820608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.820718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.820921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.821017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.821237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.821330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.821545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.821663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.821850 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.821947 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.822198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.822344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.822514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.822617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.822827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.822933 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.823151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.823247 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.823468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.823585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.824322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.824460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.824638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.824740 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.824953 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.825152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.825361 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.825461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.825634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.826007 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.826370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.826703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.827022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.827343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.827664 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.827987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.828305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.828490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.828665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.828852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.828953 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.829234 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.829346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.829552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.829679 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.829869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.830014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.830348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.830461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.830547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.830696 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.830837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.831022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.831152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.831375 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.831466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.831720 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.831825 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.832066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.832170 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.832441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.832546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.832768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.832865 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.833092 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.833188 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.833408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.833504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.833723 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.833829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.834042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.834199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.834390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.834501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.834728 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.834820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.835060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.835160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.835577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.835694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.835816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836191 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836364 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836648 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.836936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.837031 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.837230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.837338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.837550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.837644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.837900 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.837997 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.838239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.838355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.838552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.838649 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.838880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.838983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.839213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.839351 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.839548 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.839683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.839982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.840080 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.840299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.840396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.840631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.840771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.840970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.841077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.841294 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.841393 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.841628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.841742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.841945 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.842099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.842287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.842388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.842607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.842706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.842914 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.843010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.843222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.843319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.843531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.843628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.843844 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.843962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.844151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.844248 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.844459 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.844564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.844766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.844871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.845074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.845188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.845395 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.845569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.845722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.845888 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.846232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.846401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.846401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.846700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.846845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.847013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.847160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.847303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.847447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.847600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.847753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.847898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.848042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.848186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.848339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.848492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.848648 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.848800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.848954 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.849111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.849256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.849401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.849554 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.849699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.849844 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.849995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.850163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.850259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.850390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.850488 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.850710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.850814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.851024 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.851130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.851332 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.851427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.851643 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.851748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.851961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.852065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.852270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.852540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.852637 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.852878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.853012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.853199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.853315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.853550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.854974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.854974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855240 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.855897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856633 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856778 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.856943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.857995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.858688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.858793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.858793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.858992 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.859336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.859635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.859948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.860264 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.860575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.860884 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.861192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.861503 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.861808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.862298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.862423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.862659 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.862757 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.863049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.863133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.863378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.863472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.863694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.863788 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.864004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.864096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.864315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.864422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.864624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.864977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.865168 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.865314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.865604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.865755 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.865900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.866431 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.866598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.866598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.866885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.867042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.867199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.867354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.867510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.867706 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.867852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.868092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.868245 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.868640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.868806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.868969 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.869407 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.869553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.869698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.869876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.870029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.870435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.871119 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.871331 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.871499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.871644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.871958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.872103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.872259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.872502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.872656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.872883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.873198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.873365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.873510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.873735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.873880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.874141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.874312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.874459 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.874772 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.874918 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.875104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.875391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.875536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.875750 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.875894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.876072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.876447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.876712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.876712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.877005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.877150 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.877309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.877464 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.877642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.877807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.877970 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.878276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.878424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.878812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.878959 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.879115 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.879270 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.879414 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.879559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.879712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.879868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.880096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.880247 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.880413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.880652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.880797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.881021 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.881165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.881351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.881612 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.881778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.881994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.882336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.882496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.882747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.882956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.883115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.883425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.883582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.883789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.883940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.884137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.884414 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.884568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.884755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.884931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.885088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.885382 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.885538 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.885696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.886001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.887059 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.887059 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.887377 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.887525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.887682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.887837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.887837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.888134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.888296 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.888441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.888594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.889004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.889162 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.889323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.889323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.889628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.889841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.889987 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.890219 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.890386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.890546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.890824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.890993 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.891178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.891340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.891499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.891797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.891977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.892134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.892329 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.892474 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.892707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.893002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.893191 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.893352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.893534 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.893694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.893855 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.894097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.894270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.894448 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.894548 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.894836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.895023 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.895149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.895458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.895625 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.895787 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.896099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.896202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.896407 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.896687 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.896784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.897223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.897345 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.897438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.897611 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.897806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.897912 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.898236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.898521 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.898627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.899091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.899204 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.899294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.899561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.899671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.899874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.900185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.900281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.900541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.900762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.900859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.901161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.901343 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.901471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.901874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.901994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.902139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.902462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.902566 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.902789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.903071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.903270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.903408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.903608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.903758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.904082 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.904208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.904614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.904721 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.904963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.905197 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.905294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.905663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.905770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.905936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.906283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.906404 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.906594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.906902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.906998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.907423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.907529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.907813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.907919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.908179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.908418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.908526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.908740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.909050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.909325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.909429 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.909609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.909714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.909948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.910233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.910352 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.910588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.910816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.910919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.911196 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.911385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.911490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.911809 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.911973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.912154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.912475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.912580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.912796 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.913050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.913174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.913421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.913630 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.913740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.914031 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.914246 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.914414 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.914672 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.914829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.914991 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.915307 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.915405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.915627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.915891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.916015 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.916356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.916453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.916671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.916949 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.917052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.918004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.918267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.918371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.918450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.918772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.919174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.919443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.919699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.920033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.921207 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.921336 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.921440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923542 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.923834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.925250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.925250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.925250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.925250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.925250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.926052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.926218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.926382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.926528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.926683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.926827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.926827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.927111 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.927280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.927280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.927665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.927822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.928247 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.928413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.928413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.928689 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.928834 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.928834 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.929117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.929379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.929379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.929831 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.929978 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.930161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.930306 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.930306 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.930600 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.930744 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.930744 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931026 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931342 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931931 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.931931 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.932221 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.932378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.932378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.932861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.933715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.933715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.933953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934039 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934039 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.934865 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.935099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.936424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.936561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.938563 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.938694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.938779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.938855 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.940364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.940364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.940364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.940816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.940978 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941288 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941288 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.941714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.942284 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.942432 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.942432 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.942717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.942879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.943023 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.943167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.943310 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.943456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.943456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.943456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.943886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.944043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.944201 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.944358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.944358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.944735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.944880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.944880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.945211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.945373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.945373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.945773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.945919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.945919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.946363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.946611 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.946611 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:05:28.946903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.946903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.946903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.946903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.946903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.947704 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.947900 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.948257 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.948871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.949054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.949444 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.949834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.950411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.950634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.951030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.951420 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.951813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.952198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.952586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.952975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.953398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.953815 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.954236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.954646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.955042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.955448 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.955846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.956250 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.956683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.957052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.957443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.957858 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.958271 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.958817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.959222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.959622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.960124 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.960542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.960955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.961372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.961760 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.962223 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.962629 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.963035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.963436 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.963831 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.964280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.964674 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.965093 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.965514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.965910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.966326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.966799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.967118 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.967511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.967910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.968314 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.968730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.969205 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.969528 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.969935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.970366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.970806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.971203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.971633 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.972045 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.972443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.972838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.973225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 12:05:28.973547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 12:05:29.006134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Registered counter for database nova_api Sep 09 12:05:29.027718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.034574 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.037655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Registered counter for database nova_api Sep 09 12:05:29.058646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.065836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.092349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.context [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0bbb56c1-39d5-497b-b58d-1536df774c9a(cell1) {{(pid=120720) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:05:29.096426 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:05:29.096903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:05:29.098535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:05:29.099295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:05:29.099749 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:05:29.101737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:05:29.103772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Registered counter for database nova_cell0 Sep 09 12:05:29.107897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Registered counter for database nova_cell1 Sep 09 12:05:29.115873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.117728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.124581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.125044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.context [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0bbb56c1-39d5-497b-b58d-1536df774c9a(cell1) {{(pid=120719) load_cells /opt/stack/nova/nova/context.py:464}} Sep 09 12:05:29.125890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.129352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:05:29.129839 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:05:29.131562 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:05:29.132349 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:05:29.132805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:05:29.135958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:05:29.138993 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Registered counter for database nova_cell0 Sep 09 12:05:29.144002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Registered counter for database nova_cell1 Sep 09 12:05:29.154180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.155958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.167191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.167732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.279099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO dbcounter [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Registered counter for database nova_cell0 Sep 09 12:05:29.286222 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_db.sqlalchemy.engines [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.290768 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writer thread running {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.332814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO dbcounter [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Registered counter for database nova_cell0 Sep 09 12:05:29.341576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_db.sqlalchemy.engines [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 12:05:29.345967 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writer thread running {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 12:05:29.611881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:05:29.619552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:05:29.676320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:05:29.683737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:05:29.963627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:05:29.969612 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: WARNING keystonemiddleware.auth_token [None req-c83dda3a-4fe4-4c6f-8646-8a1a91ec199e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:05:29.975042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5610db5c59c0 pid: 120720 (default app) Sep 09 12:05:30.027322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 09 12:05:30.033361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: WARNING keystonemiddleware.auth_token [None req-b274f456-d7c2-4ca6-b529-bed8c9dbe847 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 09 12:05:30.039227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5610db5c59c0 pid: 120719 (default app) Sep 09 12:06:06.799294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:06.800709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:06.802590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:06.805239 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:06.966108 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:06.967136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:06.970174 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:06.971291 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:08.298421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c00da3c5-e30d-4541-a7a8-2e61a86bb3c9 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Action: 'create', calling method: .version_select at 0x7ff2da24c430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1790970463", "metadata": {"Type": "work"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c00da3c5-e30d-4541-a7a8-2e61a86bb3c9 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Request method failure captured: Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 122 Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywu0rd65kMSfyxSWGXxyl2GZss68RJkuSoHD7v-p1DXJvVM91frqsNT2PXTaRNF9XGA_gnW1M2YcTAHt2C7L0wvNlu7MvcxFVmimOty_3q9X0nNE1N9T2m3XzXRKNwyjG3FuU0RoZ10KhnB5iuYLxiJFefkBY1rJMUgddztQoL221k Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:08.306419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/594c0d336a634abc80b5f3f1e8541c99"}]}] Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 0dc798c340534e5ab6a5d1737ca60f07 Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1790970463", "metadata": {"Type": "work"}}} Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:08.310054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1790970463', 'metadata': {'Type': 'work'}}}} Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '#$%' Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:08.310960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:06:08.314441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:06:08.318076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 09 12:06:08.318076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.320169 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c00da3c5-e30d-4541-a7a8-2e61a86bb3c9 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:08.321488 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c00da3c5-e30d-4541-a7a8-2e61a86bb3c9 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.375923 Sep 09 12:06:08.322362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 9 12:06:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1378 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:06:08.343176 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a04c7b2-8f31-4d9f-895e-15c37cf1256e tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Action: 'create', calling method: .version_select at 0x7ff2da24cd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-375402755", "metadata": {"Type": "work"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a04c7b2-8f31-4d9f-895e-15c37cf1256e tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Request method failure captured: Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 119 Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywu0rd65kMSfyxSWGXxyl2GZss68RJkuSoHD7v-p1DXJvVM91frqsNT2PXTaRNF9XGA_gnW1M2YcTAHt2C7L0wvNlu7MvcxFVmimOty_3q9X0nNE1N9T2m3XzXRKNwyjG3FuU0RoZ10KhnB5iuYLxiJFefkBY1rJMUgddztQoL221k Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:08.355544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/594c0d336a634abc80b5f3f1e8541c99"}]}] Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 0dc798c340534e5ab6a5d1737ca60f07 Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-375402755", "metadata": {"Type": "work"}}} Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:08.357356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-375402755', 'metadata': {'Type': 'work'}}}} Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '0' Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:08.358425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:06:08.359739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:06:08.361728 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 09 12:06:08.361728 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.365186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0a04c7b2-8f31-4d9f-895e-15c37cf1256e tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:08.368330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0a04c7b2-8f31-4d9f-895e-15c37cf1256e tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038288 Sep 09 12:06:08.374026 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 2/2] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 9 12:06:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:06:08.387724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10f2ad86-88fc-43ae-9b7c-61045ef6effd tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Action: 'create', calling method: .version_select at 0x7ff2da106160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1986378338", "metadata": {"Type": "work"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10f2ad86-88fc-43ae-9b7c-61045ef6effd tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Request method failure captured: Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 119 Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywu0rd65kMSfyxSWGXxyl2GZss68RJkuSoHD7v-p1DXJvVM91frqsNT2PXTaRNF9XGA_gnW1M2YcTAHt2C7L0wvNlu7MvcxFVmimOty_3q9X0nNE1N9T2m3XzXRKNwyjG3FuU0RoZ10KhnB5iuYLxiJFefkBY1rJMUgddztQoL221k Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:08.402810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/594c0d336a634abc80b5f3f1e8541c99"}]}] Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 0dc798c340534e5ab6a5d1737ca60f07 Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1986378338", "metadata": {"Type": "work"}}} Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:08.404151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1986378338', 'metadata': {'Type': 'work'}}}} Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise error Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi '' Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:08.405008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 09 12:06:08.406410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 09 12:06:08.412237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 09 12:06:08.412237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:08.412237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10f2ad86-88fc-43ae-9b7c-61045ef6effd tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:08.412237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10f2ad86-88fc-43ae-9b7c-61045ef6effd tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024755 Sep 09 12:06:08.412237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 3/3] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 9 12:06:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 12:06:08.417392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c49661e6-e16b-48b1-9069-fd32af0ba455 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Calling method '.version_select at 0x7ff2da106b80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:08.424575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-469b6412-2679-438d-816b-a5f820084025 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Action: 'create', calling method: .version_select at 0x7ff2da24b430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-415228799"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:09.198881 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c49661e6-e16b-48b1-9069-fd32af0ba455 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] HTTP exception thrown: Volume tempest-invalid-1241846011 could not be found. Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c49661e6-e16b-48b1-9069-fd32af0ba455 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Request method failure captured: Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1241846011 HTTP/1.1 Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywu0rd65kMSfyxSWGXxyl2GZss68RJkuSoHD7v-p1DXJvVM91frqsNT2PXTaRNF9XGA_gnW1M2YcTAHt2C7L0wvNlu7MvcxFVmimOty_3q9X0nNE1N9T2m3XzXRKNwyjG3FuU0RoZ10KhnB5iuYLxiJFefkBY1rJMUgddztQoL221k Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:09.203152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/594c0d336a634abc80b5f3f1e8541c99"}]}] Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 0dc798c340534e5ab6a5d1737ca60f07 Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Volume tempest-invalid-1241846011 could not be found. Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'tempest-invalid-1241846011'} Sep 09 12:06:09.204416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1241846011 could not be found. (HTTP 404) (Request-ID: req-14022925-d1b9-40e8-b582-51e125c9a39f) Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.205296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:06:09.206450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1241846011 could not be found. Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:09.207598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1241846011 could not be found. Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1241846011 could not be found. Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c49661e6-e16b-48b1-9069-fd32af0ba455 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Returning 404 to user: Volume tempest-invalid-1241846011 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:09.208732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c49661e6-e16b-48b1-9069-fd32af0ba455 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1241846011" status: 404 len: 99 microversion: 2.1 time: 0.792985 Sep 09 12:06:09.211282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 4/4] 10.222.0.62 () {58 vars in 1218 bytes} [Fri Sep 9 12:06:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1241846011 => generated 99 bytes in 799 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 09 12:06:09.233493 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-073bd691-16ff-499c-9e01-6584e4233d07 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018024 Sep 09 12:06:09.239456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 5/5] 10.222.0.62 () {58 vars in 1140 bytes} [Fri Sep 9 12:06:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 12:06:09.250569 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1b1090d-6094-49e6-a3d6-d99eb6c3616a tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004708 Sep 09 12:06:09.256893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 6/6] 10.222.0.62 () {58 vars in 1137 bytes} [Fri Sep 9 12:06:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 09 12:06:09.265239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87995016-e3e0-4298-8e91-dc258a5e260c tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Calling method '.version_select at 0x7ff2da08cdc0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:09.307356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-87995016-e3e0-4298-8e91-dc258a5e260c tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] HTTP exception thrown: Volume d1f6ea2f-b494-419c-a993-3b1e4e93200e could not be found. Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87995016-e3e0-4298-8e91-dc258a5e260c tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Request method failure captured: Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/os-volumes/d1f6ea2f-b494-419c-a993-3b1e4e93200e HTTP/1.1 Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywu0rd65kMSfyxSWGXxyl2GZss68RJkuSoHD7v-p1DXJvVM91frqsNT2PXTaRNF9XGA_gnW1M2YcTAHt2C7L0wvNlu7MvcxFVmimOty_3q9X0nNE1N9T2m3XzXRKNwyjG3FuU0RoZ10KhnB5iuYLxiJFefkBY1rJMUgddztQoL221k Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:09.311475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/594c0d336a634abc80b5f3f1e8541c99"}]}] Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 0dc798c340534e5ab6a5d1737ca60f07 Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Volume d1f6ea2f-b494-419c-a993-3b1e4e93200e could not be found. Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'd1f6ea2f-b494-419c-a993-3b1e4e93200e'} Sep 09 12:06:09.313020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1f6ea2f-b494-419c-a993-3b1e4e93200e could not be found. (HTTP 404) (Request-ID: req-b5d76356-bd2d-4600-a511-6c70796c466b) Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.314079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:06:09.316360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1f6ea2f-b494-419c-a993-3b1e4e93200e could not be found. Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:06:09.317835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1f6ea2f-b494-419c-a993-3b1e4e93200e could not be found. Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1f6ea2f-b494-419c-a993-3b1e4e93200e could not be found. Sep 09 12:06:09.319192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.320974 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-87995016-e3e0-4298-8e91-dc258a5e260c tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Returning 404 to user: Volume d1f6ea2f-b494-419c-a993-3b1e4e93200e could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:09.324724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-87995016-e3e0-4298-8e91-dc258a5e260c tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/d1f6ea2f-b494-419c-a993-3b1e4e93200e" status: 404 len: 109 microversion: 2.1 time: 0.064875 Sep 09 12:06:09.325563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 7/7] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:06:09 2022] DELETE /compute/v2.1/os-volumes/d1f6ea2f-b494-419c-a993-3b1e4e93200e => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:06:09.341209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4dad228-d3e0-462f-8cde-19394cedd087 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Calling method '.version_select at 0x7ff2da036550>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:09.395419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-c4dad228-d3e0-462f-8cde-19394cedd087 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] HTTP exception thrown: Volume 25db9b25-1203-445a-b9d0-7b6c511feab3 could not be found. Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4dad228-d3e0-462f-8cde-19394cedd087 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Request method failure captured: Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/os-volumes/25db9b25-1203-445a-b9d0-7b6c511feab3 HTTP/1.1 Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywu0rd65kMSfyxSWGXxyl2GZss68RJkuSoHD7v-p1DXJvVM91frqsNT2PXTaRNF9XGA_gnW1M2YcTAHt2C7L0wvNlu7MvcxFVmimOty_3q9X0nNE1N9T2m3XzXRKNwyjG3FuU0RoZ10KhnB5iuYLxiJFefkBY1rJMUgddztQoL221k Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:09.397804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/594c0d336a634abc80b5f3f1e8541c99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/594c0d336a634abc80b5f3f1e8541c99"}]}] Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 594c0d336a634abc80b5f3f1e8541c99 Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-1870708247 Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 0dc798c340534e5ab6a5d1737ca60f07 Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-1870708247-project Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Volume 25db9b25-1203-445a-b9d0-7b6c511feab3 could not be found. Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '25db9b25-1203-445a-b9d0-7b6c511feab3'} Sep 09 12:06:09.399160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25db9b25-1203-445a-b9d0-7b6c511feab3 could not be found. (HTTP 404) (Request-ID: req-ec414593-48f5-453e-836a-c22e7ab37c5e) Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.399956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:09.401845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25db9b25-1203-445a-b9d0-7b6c511feab3 could not be found. Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:06:09.404692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25db9b25-1203-445a-b9d0-7b6c511feab3 could not be found. Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25db9b25-1203-445a-b9d0-7b6c511feab3 could not be found. Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c4dad228-d3e0-462f-8cde-19394cedd087 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] Returning 404 to user: Volume 25db9b25-1203-445a-b9d0-7b6c511feab3 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c4dad228-d3e0-462f-8cde-19394cedd087 tempest-VolumesNegativeTest-1870708247 tempest-VolumesNegativeTest-1870708247-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/25db9b25-1203-445a-b9d0-7b6c511feab3" status: 404 len: 109 microversion: 2.1 time: 0.067032 Sep 09 12:06:09.407043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 8/8] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:09 2022] GET /compute/v2.1/os-volumes/25db9b25-1203-445a-b9d0-7b6c511feab3 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:06:09.977507 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-469b6412-2679-438d-816b-a5f820084025 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.196168 Sep 09 12:06:09.979560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 1/9] 10.222.0.62 () {60 vars in 1155 bytes} [Fri Sep 9 12:06:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3199 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 12:06:10.002825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0797b66-326d-4358-9455-1f9ccc1cd6f1 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da08cb80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:10.215335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0797b66-326d-4358-9455-1f9ccc1cd6f1 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 200 len: 344 microversion: 2.1 time: 0.195382 Sep 09 12:06:10.215335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 9/10] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:09 2022] GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:11.202664 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e25f6f28-6387-4f08-b881-9d422bf40e85 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da11c310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:11.298951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e25f6f28-6387-4f08-b881-9d422bf40e85 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 200 len: 344 microversion: 2.1 time: 0.103155 Sep 09 12:06:11.299794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 2/11] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:11 2022] GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:12.314203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09d2fa4a-1023-4fe0-911b-e710736f89ad tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da036430>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:12.441472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09d2fa4a-1023-4fe0-911b-e710736f89ad tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 200 len: 345 microversion: 2.1 time: 0.130394 Sep 09 12:06:12.442055 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 10/12] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:12 2022] GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:12.460217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b61c8965-76bf-446f-8b3b-e871fc63fb44 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Action: 'create', calling method: .version_select at 0x7ff2da11c940>, body: {"snapshot": {"volume_id": "13087cb1-6636-4c73-9559-8e1b5ed6bc68", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1269957312"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:13.126329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b61c8965-76bf-446f-8b3b-e871fc63fb44 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.672996 Sep 09 12:06:13.132746 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 3/13] 10.222.0.62 () {60 vars in 1162 bytes} [Fri Sep 9 12:06:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:13.141915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-82bb08c8-a2b3-4d17-afd6-9011021f177b tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da043040>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:13.262008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-82bb08c8-a2b3-4d17-afd6-9011021f177b tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.127509 Sep 09 12:06:13.264144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 11/14] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:13 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:13.279368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d54446e9-6438-40c2-ab3d-51add20e12ca tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da0b9c10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:13.434617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d54446e9-6438-40c2-ab3d-51add20e12ca tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.159935 Sep 09 12:06:13.435338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 4/15] 10.222.0.62 () {58 vars in 1140 bytes} [Fri Sep 9 12:06:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:13.457189 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37767e64-be4b-4f47-ae08-f7a8c42c4a32 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da0364c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:13.537158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37767e64-be4b-4f47-ae08-f7a8c42c4a32 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.088233 Sep 09 12:06:13.537736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 12/16] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:13 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:14.556537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c193467-2ff4-44da-ba93-40b326637e14 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da11c4c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:14.617901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c193467-2ff4-44da-ba93-40b326637e14 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.070589 Sep 09 12:06:14.618648 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 5/17] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:14 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:15.639532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4aa2a9c7-b8d9-4d3e-9045-27701b5257bd tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da08c940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:15.707435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4aa2a9c7-b8d9-4d3e-9045-27701b5257bd tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.079604 Sep 09 12:06:15.720443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 13/18] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:15 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:16.729703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5b8c2a7-f0c2-4f96-abf4-b6c2be542845 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da0b98b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:16.805507 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5b8c2a7-f0c2-4f96-abf4-b6c2be542845 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.084479 Sep 09 12:06:16.806077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 6/19] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:16 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:17.744166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2048123729", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "networks": [{"uuid": "e317e4d0-e6a7-4ee0-837e-905fdf7f3cfc"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:17.828135 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a147797b-fcaf-4863-949b-31421589e5e5 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2da0b91f0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:17.918377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a147797b-fcaf-4863-949b-31421589e5e5 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.102996 Sep 09 12:06:17.919522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 7/20] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:17 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:18.034165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] validate_networks() for [('e317e4d0-e6a7-4ee0-837e-905fdf7f3cfc', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:06:19.025222 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-334832799", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:19.187728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] validate_networks() for [('f999017b-0f3c-4e53-b641-07ec705a6546', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:06:20.640631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:06:20.641291 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:06:20.641780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:06:20.642216 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:06:20.642641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:06:20.675019 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:20.676487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:20.676994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:20.677975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:20.678636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:20.679089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:20.753962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for project c9860574ff3947e3bc61a76e6883107a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:20.773487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for user 9c0f1bfeb1464f87a7f3ea4add940861 and project c9860574ff3947e3bc61a76e6883107a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:20.803006 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:06:20.805838 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:06:20.963363 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-176d8568-60c3-4ba6-940e-785b4973d0c4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.201041 Sep 09 12:06:20.964652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 8/21] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:06:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:06:20.975475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fa11185e-79f5-46f5-872d-fbe4a2f76ed2 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d97cc4c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:21.062399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fa11185e-79f5-46f5-872d-fbe4a2f76ed2 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 288 microversion: 2.1 time: 0.096145 Sep 09 12:06:21.063282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 9/22] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:20 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:21.082160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f376d2e-db3f-4eac-8186-b840dee833c7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:21.083312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f376d2e-db3f-4eac-8186-b840dee833c7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:21.380052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f376d2e-db3f-4eac-8186-b840dee833c7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:21.397652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f376d2e-db3f-4eac-8186-b840dee833c7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1221 microversion: 2.1 time: 0.333310 Sep 09 12:06:21.398463 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 10/23] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:21 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1221 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:21.403387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aaed3e4f-9052-41c6-9704-9e434fc29367 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d97cc820>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:21.535836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aaed3e4f-9052-41c6-9704-9e434fc29367 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 202 len: 0 microversion: 2.1 time: 0.135517 Sep 09 12:06:21.536628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 11/24] 10.222.0.62 () {58 vars in 1254 bytes} [Fri Sep 9 12:06:21 2022] DELETE /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:06:21.545946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1deac81-a528-4546-95a6-4b9f85bf2bf4 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d9772790>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:21.603632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1deac81-a528-4546-95a6-4b9f85bf2bf4 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.062519 Sep 09 12:06:21.604453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 12/25] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:21 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:06:21.632570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-852987849", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:21.721740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] validate_networks() for [('f999017b-0f3c-4e53-b641-07ec705a6546', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:06:21.962245 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:06:21.963354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:06:21.964055 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:06:21.964715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:06:21.965195 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:06:22.008910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:22.011839 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:22.012678 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:22.014059 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:22.014878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:22.019656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:22.106336 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Getting quotas for project 19d3583d753d4efab0bcd6769574420b. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:22.125284 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Getting quotas for user 326c59915e3d4b7289472d1400730a07 and project 19d3583d753d4efab0bcd6769574420b. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:22.151282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:06:22.155469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:06:22.366578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-09995298-0043-4b73-b5e6-0daf52eeba33 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.060363 Sep 09 12:06:22.369370 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 14/26] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 5066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:06:22.389699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c28ab417-a9b5-48fe-9f2a-a60f67fd0c25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:22.391799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c28ab417-a9b5-48fe-9f2a-a60f67fd0c25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:22.633617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:06:22.634433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:06:22.635269 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:06:22.635839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:06:22.636531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:06:22.675694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:22.676272 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:22.676587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:22.677783 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:22.678875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:22.679459 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:22.744457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for project c9860574ff3947e3bc61a76e6883107a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:22.765351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for user 9c0f1bfeb1464f87a7f3ea4add940861 and project c9860574ff3947e3bc61a76e6883107a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:22.791919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:06:22.799766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:06:22.813509 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c28ab417-a9b5-48fe-9f2a-a60f67fd0c25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:22.841131 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c28ab417-a9b5-48fe-9f2a-a60f67fd0c25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1215 microversion: 2.1 time: 0.463660 Sep 09 12:06:22.845119 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 15/27] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:22 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1215 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:22.868411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fdb7625-7e73-4a14-a352-6caa52cc5d94 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d9755b80>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:22.956643 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7956250e-f5e6-4b6a-bc9c-11396d2b5b63 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.328146 Sep 09 12:06:22.960932 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 13/28] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:06:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:06:22.974102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29b793aa-2a99-4a5a-9ebe-b459dd9a4a0c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:22.975537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29b793aa-2a99-4a5a-9ebe-b459dd9a4a0c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:22.983175 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fdb7625-7e73-4a14-a352-6caa52cc5d94 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.135937 Sep 09 12:06:22.984603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 16/29] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:22 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:23.188478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-29b793aa-2a99-4a5a-9ebe-b459dd9a4a0c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:23.195470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29b793aa-2a99-4a5a-9ebe-b459dd9a4a0c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1221 microversion: 2.1 time: 0.229897 Sep 09 12:06:23.200781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 14/30] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:22 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1221 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:23.866616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c5896eb-12ee-43de-83f0-225761518153 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:23.871602 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c5896eb-12ee-43de-83f0-225761518153 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:23.997408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d03431e-f7c0-4e57-a1d6-df5bc7c10528 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d9779280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:24.089269 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d03431e-f7c0-4e57-a1d6-df5bc7c10528 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.095997 Sep 09 12:06:24.090247 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 15/31] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:23 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:24.127995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c5896eb-12ee-43de-83f0-225761518153 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:24.148003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c5896eb-12ee-43de-83f0-225761518153 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1215 microversion: 2.1 time: 0.277912 Sep 09 12:06:24.152174 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 17/32] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:23 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1215 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:24.224182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:24.225186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:24.239086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:24.240091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:24.242636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:24.246298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:24.247461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:24.250076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:24.554602 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:24.595956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-79f33e68-06c7-4bd7-a6f0-8564000ec088 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1225 microversion: 2.1 time: 0.376001 Sep 09 12:06:24.597839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 16/33] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:24 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1225 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:25.102603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff8cadba-be8b-424a-b036-de6c81eabdd6 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d976a820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:25.163181 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff8cadba-be8b-424a-b036-de6c81eabdd6 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.064459 Sep 09 12:06:25.163864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 18/34] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:25 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:25.174091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:25.174900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:25.196777 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:25.197592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:25.198325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:25.200402 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:25.201108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:25.206266 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:25.409156 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:25.427016 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e30a2e6a-27cd-4a1b-858d-74716593f80f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1219 microversion: 2.1 time: 0.256902 Sep 09 12:06:25.430580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 17/35] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:25 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1219 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:25.625088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:25.625937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:25.641359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:25.647016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:25.648625 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:25.654136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:25.656482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:25.658521 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:26.178281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a44f3c1c-c7db-448e-8ddc-9306698f6f4d tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d96f4280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:26.267812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a44f3c1c-c7db-448e-8ddc-9306698f6f4d tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 200 len: 287 microversion: 2.1 time: 0.093921 Sep 09 12:06:26.273074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 18/36] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:26 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:06:26.463404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:26.466770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:26.495968 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:26.497492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:26.503182 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:26.503793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:26.507149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:26.509588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:26.510375 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:26.537190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b3a2d82c-8250-450a-ad72-85bfedbe1fd9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1225 microversion: 2.1 time: 0.917004 Sep 09 12:06:26.550514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 19/37] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:25 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1225 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:26.816022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:26.830726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c04209ed-dff3-4116-b8bf-5ba4e3c8b00a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1211 microversion: 2.1 time: 0.378385 Sep 09 12:06:26.831582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 19/38] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:26 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1211 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:27.285556 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6590a178-dacb-44cb-be6f-98a7bc2e0de8 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d96ec820>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:27.569318 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:27.572485 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:27.600976 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:27.601848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:27.603717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:27.603717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:27.614754 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:27.615689 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:27.984810 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:27.993137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-241cd7ac-aaa5-4946-a540-a408d234edd4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1273 microversion: 2.1 time: 0.431208 Sep 09 12:06:28.014302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 20/39] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:27 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1273 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:28.030557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:28.035505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:28.050613 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:28.059498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:28.061075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:28.062007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:28.068715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:28.069445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:28.375194 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-6590a178-dacb-44cb-be6f-98a7bc2e0de8 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] HTTP exception thrown: Snapshot 5f0d2eea-3640-46b6-8423-c85ba9824334 could not be found. Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6590a178-dacb-44cb-be6f-98a7bc2e0de8 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Request method failure captured: Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 HTTP/1.1 Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywuG_56mGveaQr2xkOYfOh2jOjFmokkzyjNspzVeiLA7ADmHSkG5C5Bx0jcZwLO2hk-WqIy4cuPIEYx1RdVaV5O6nmxlYiJTsQKle4ia5A6a5aJJeLcubn6RXwJlu7hE8ensBnzJe2lCOK3wEkpBUsqUNc_YqoOoRoKIymLTJn59Kk Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:28.379587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_414b3c8f1b29468684a54865d838effe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/414b3c8f1b29468684a54865d838effe"}]}] Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 9af5557669984780a427691d752922a1 Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Snapshot 5f0d2eea-3640-46b6-8423-c85ba9824334 could not be found. Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '5f0d2eea-3640-46b6-8423-c85ba9824334'} Sep 09 12:06:28.380925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5f0d2eea-3640-46b6-8423-c85ba9824334 could not be found. (HTTP 404) (Request-ID: req-195df253-d98f-4fb9-8336-75c757fac831) Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:28.381737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:28.382899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5f0d2eea-3640-46b6-8423-c85ba9824334 could not be found. Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 09 12:06:28.383853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5f0d2eea-3640-46b6-8423-c85ba9824334 could not be found. Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5f0d2eea-3640-46b6-8423-c85ba9824334 could not be found. Sep 09 12:06:28.387004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:28.389406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6590a178-dacb-44cb-be6f-98a7bc2e0de8 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Returning 404 to user: Snapshot 5f0d2eea-3640-46b6-8423-c85ba9824334 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:28.390828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6590a178-dacb-44cb-be6f-98a7bc2e0de8 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334" status: 404 len: 111 microversion: 2.1 time: 1.113985 Sep 09 12:06:28.391831 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 20/40] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:06:27 2022] GET /compute/v2.1/os-snapshots/5f0d2eea-3640-46b6-8423-c85ba9824334 => generated 111 bytes in 1115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:06:28.403129 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96f1dc58-f076-4499-ad4e-d1f73e0b4eb5 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d96ec940>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:28.625989 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:28.650802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfb6ffcc-bfb7-4a32-9966-2a6812959ea1 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1267 microversion: 2.1 time: 0.624906 Sep 09 12:06:28.653411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 21/41] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:28 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1267 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:28.733805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96f1dc58-f076-4499-ad4e-d1f73e0b4eb5 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 202 len: 0 microversion: 2.1 time: 0.337288 Sep 09 12:06:28.735242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 21/42] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:06:28 2022] DELETE /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:06:28.743401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3f687384-3eef-43c4-8127-0503c8146e2a tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d96db310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:28.944511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3f687384-3eef-43c4-8127-0503c8146e2a tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 200 len: 344 microversion: 2.1 time: 0.205164 Sep 09 12:06:28.950286 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 22/43] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:28 2022] GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:29.022306 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:29.024019 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:29.034943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:29.035693 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:29.036330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:29.037209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:29.038252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:29.038838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:29.481495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:29.499326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51f0cc2b-8df8-4b4b-8469-0ab57c6baacd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1279 microversion: 2.1 time: 0.481920 Sep 09 12:06:29.504242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 22/44] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:29 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1279 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:29.677743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:29.678640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:29.690058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:29.690587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:29.691023 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:29.691733 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:29.692186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:29.692609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:30.236268 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:30.253696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c3b3f353-db31-4289-b2be-6ef0dfff45c0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1273 microversion: 2.1 time: 0.576481 Sep 09 12:06:30.258561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 23/45] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:29 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1273 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:30.292394 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ebf09eb0-8d87-4e4a-90c7-e1ef08f5d64b tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d96dbaf0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:30.330866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f34b2a5-ab67-4906-b667-1de816feeeda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'create', calling method: .version_select at 0x7ff2d96ae430>, body: {"keypair": {"name": "tempest-keypair-927031755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAYD23oq6bvyL5N8h8VpaJpskHXzwiX39dIylj5H58trN5YlAnGsaaBlPCzP29Y7dTLOt2+ZpTpYW1ZmV+zqKoZDjBAkxdxXRJmNsbTRQ9P13rqlB5QbMjGyGlb+hn+eg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:30.440384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ebf09eb0-8d87-4e4a-90c7-e1ef08f5d64b tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] HTTP exception thrown: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ebf09eb0-8d87-4e4a-90c7-e1ef08f5d64b tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Request method failure captured: Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 HTTP/1.1 Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGywuG_56mGveaQr2xkOYfOh2jOjFmokkzyjNspzVeiLA7ADmHSkG5C5Bx0jcZwLO2hk-WqIy4cuPIEYx1RdVaV5O6nmxlYiJTsQKle4ia5A6a5aJJeLcubn6RXwJlu7hE8ensBnzJe2lCOK3wEkpBUsqUNc_YqoOoRoKIymLTJn59Kk Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:06:30.445171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_414b3c8f1b29468684a54865d838effe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/414b3c8f1b29468684a54865d838effe"}]}] Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9af5557669984780a427691d752922a1 Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '13087cb1-6636-4c73-9559-8e1b5ed6bc68'} Sep 09 12:06:30.446734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. (HTTP 404) (Request-ID: req-a040720d-b193-4bef-b7be-cf222c748583) Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.448252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:30.449526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:06:30.450631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ebf09eb0-8d87-4e4a-90c7-e1ef08f5d64b tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Returning 404 to user: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ebf09eb0-8d87-4e4a-90c7-e1ef08f5d64b tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 404 len: 109 microversion: 2.1 time: 0.185921 Sep 09 12:06:30.451624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 24/46] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:30 2022] GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:06:30.483112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-0f34b2a5-ab67-4906-b667-1de816feeeda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for project 002ffc44d77748ae9c618229e21f41e8. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:30.496743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b50488d-9190-43b2-b277-b5a5747e7329 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d97cc8b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:30.504592 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-0f34b2a5-ab67-4906-b667-1de816feeeda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for user 9676597a1b884138bf5435f3b6cd63c1 and project 002ffc44d77748ae9c618229e21f41e8. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:30.583482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-0b50488d-9190-43b2-b277-b5a5747e7329 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] HTTP exception thrown: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b50488d-9190-43b2-b277-b5a5747e7329 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Request method failure captured: Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 HTTP/1.1 Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGywuG_56mGveaQr2xkOYfOh2jOjFmokkzyjNspzVeiLA7ADmHSkG5C5Bx0jcZwLO2hk-WqIy4cuPIEYx1RdVaV5O6nmxlYiJTsQKle4ia5A6a5aJJeLcubn6RXwJlu7hE8ensBnzJe2lCOK3wEkpBUsqUNc_YqoOoRoKIymLTJn59Kk Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:06:30.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_414b3c8f1b29468684a54865d838effe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/414b3c8f1b29468684a54865d838effe"}]}] Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9af5557669984780a427691d752922a1 Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '13087cb1-6636-4c73-9559-8e1b5ed6bc68'} Sep 09 12:06:30.586880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. (HTTP 404) (Request-ID: req-87d63d62-8478-48c5-a8f3-32fb3020df87) Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.588112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 09 12:06:30.589575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 09 12:06:30.590841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b50488d-9190-43b2-b277-b5a5747e7329 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Returning 404 to user: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b50488d-9190-43b2-b277-b5a5747e7329 tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 404 len: 109 microversion: 2.1 time: 0.134377 Sep 09 12:06:30.592632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 25/47] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:06:30 2022] DELETE /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:06:30.617185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:30.617185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:30.647347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f34b2a5-ab67-4906-b667-1de816feeeda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.742499 Sep 09 12:06:30.649110 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 23/48] 10.222.0.62 () {62 vars in 1200 bytes} [Fri Sep 9 12:06:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 745 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 09 12:06:30.669621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b7005da-92ae-4dda-8bc8-0b0577f9480f tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Calling method '.version_select at 0x7ff2d968d0d0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:30.684902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:30.685665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:30.686152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:30.688793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:30.690644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:30.692428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:30.774462 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2b7005da-92ae-4dda-8bc8-0b0577f9480f tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] HTTP exception thrown: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b7005da-92ae-4dda-8bc8-0b0577f9480f tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Request method failure captured: Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 HTTP/1.1 Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGywuG_56mGveaQr2xkOYfOh2jOjFmokkzyjNspzVeiLA7ADmHSkG5C5Bx0jcZwLO2hk-WqIy4cuPIEYx1RdVaV5O6nmxlYiJTsQKle4ia5A6a5aJJeLcubn6RXwJlu7hE8ensBnzJe2lCOK3wEkpBUsqUNc_YqoOoRoKIymLTJn59Kk Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:06:30.777303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_414b3c8f1b29468684a54865d838effe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/414b3c8f1b29468684a54865d838effe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/414b3c8f1b29468684a54865d838effe"}]}] Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 414b3c8f1b29468684a54865d838effe Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1234083724 Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 9af5557669984780a427691d752922a1 Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1234083724-project Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '13087cb1-6636-4c73-9559-8e1b5ed6bc68'} Sep 09 12:06:30.778454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. (HTTP 404) (Request-ID: req-96275a78-b570-46e1-ab4d-5322034069ff) Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.779190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:06:30.780139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:06:30.782514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b7005da-92ae-4dda-8bc8-0b0577f9480f tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] Returning 404 to user: Volume 13087cb1-6636-4c73-9559-8e1b5ed6bc68 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b7005da-92ae-4dda-8bc8-0b0577f9480f tempest-VolumesSnapshotsTestJSON-1234083724 tempest-VolumesSnapshotsTestJSON-1234083724-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68" status: 404 len: 109 microversion: 2.1 time: 0.127454 Sep 09 12:06:30.785318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 24/49] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:30 2022] GET /compute/v2.1/os-volumes/13087cb1-6636-4c73-9559-8e1b5ed6bc68 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:06:31.054252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:31.064874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12d6eca2-239c-479c-9bd6-32128a8e82a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1279 microversion: 2.1 time: 0.473201 Sep 09 12:06:31.065452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 26/50] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:30 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1279 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:31.141005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a6994c2-0015-4a09-88bd-8f4cabf01a64 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'create', calling method: .version_select at 0x7ff2d96ae1f0>, body: {"keypair": {"name": "tempest-keypair-1794773310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIo7Yn2KhOGsYcqrrVZabPjblPzP7NyQMCLtS5RqZIcS/dyt2mA8Czj6Qk/lYs9emQaU/TgLll98m7rgV+LVucGu2Km5nyjQfzZ4gVzoxThuzC8irYUDXHp2zEBHKxOqUw=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:31.223505 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-6a6994c2-0015-4a09-88bd-8f4cabf01a64 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:31.229324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-6a6994c2-0015-4a09-88bd-8f4cabf01a64 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for user bfc29d15a7344754aa53d55379e2751f and project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:31.285118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:31.285456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a6994c2-0015-4a09-88bd-8f4cabf01a64 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.303179 Sep 09 12:06:31.286213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:31.287872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:06:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:31.292434 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:31.304570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:31.306550 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:31.308730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:31.319274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:31.330530 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:31.588628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:31.611519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c26dbf9f-15f5-4bf7-b342-4275ca2f4405 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1273 microversion: 2.1 time: 0.330147 Sep 09 12:06:31.620514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 27/52] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:31 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:32.097538 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:32.098223 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:32.100536 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:32.115470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:32.117230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:32.120218 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:32.122137 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:32.123246 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:32.125130 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:32.658405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:32.661464 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:32.684915 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:32.689047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:32.691977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:32.694249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:32.696437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:32.700901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:32.732758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:32.964858 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:32.980088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-016c18c6-12df-4f6d-8c78-80a4c3bb7a24 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1273 microversion: 2.1 time: 0.337615 Sep 09 12:06:32.980937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 28/53] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:32 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:33.656000 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:33.672809 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-781277f9-06b6-442b-99af-10a82d65ebd7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1279 microversion: 2.1 time: 1.579910 Sep 09 12:06:33.673401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 26/54] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:32 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1279 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:34.011791 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:34.012623 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:34.014465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=16 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:34.030871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:34.031736 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:34.032509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:34.033415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:34.034998 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:34.038934 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:34.248854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:34.264027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8864bd7a-7a24-48d9-8b56-974592e88a00 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1273 microversion: 2.1 time: 0.260457 Sep 09 12:06:34.268052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 29/55] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:34 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1273 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:34.700056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:34.700822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:34.708770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:34.722415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:34.722415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:34.722415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:34.722415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:34.722755 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:34.976506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:34.992148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dc536e03-5a1e-478c-b712-0526d2c91b67 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1279 microversion: 2.1 time: 0.296073 Sep 09 12:06:34.995675 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 27/56] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:34 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:35.296459 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:35.297835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:35.312855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:35.314812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:35.318406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:35.321089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:35.322372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:35.326816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:36.029163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:36.033833 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:36.068080 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:36.077452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:36.077917 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:36.082494 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:36.089301 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:36.092871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:37.120655 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:37.139330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d24b649-480a-45d5-8652-b5d82a391290 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 1.847764 Sep 09 12:06:37.145560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 30/57] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:35 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:37.721451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:37.740688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-512f3892-2a81-4152-a091-be0f7057b13e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 1.719886 Sep 09 12:06:37.742225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 28/58] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:36 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:37.804390 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f6251ac0-be9b-43a0-8f3e-d044cbadc4fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: .version_select at 0x7ff2d96dbaf0>, body: {"keypair": {"name": "tempest-keypair-1051219595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA+YV22A/oUsio+tczNDoXDF4VtkUGLPzQ0+00X3Fn7A614EWsO1keDJ07Xdn6PnB4QKLVfxvqPNwpEJ64VWZtNlFawa1sK2/dDGVGhCnox/b1Ax1kDQBWtEuHRCqzaJg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:37.926150 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f6251ac0-be9b-43a0-8f3e-d044cbadc4fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:37.961262 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f6251ac0-be9b-43a0-8f3e-d044cbadc4fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:38.077178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f6251ac0-be9b-43a0-8f3e-d044cbadc4fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.930273 Sep 09 12:06:38.078047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 31/59] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:06:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:38.177531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:38.178326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:38.220644 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:38.222461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:38.223036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:38.231868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:38.235971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:38.237839 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:38.770410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:38.771055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:38.782207 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:38.782709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:38.783608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:38.783818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:38.784271 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:38.784696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:39.355840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:39.368261 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd32f38a-4687-4f4a-9003-fdca6f2f9b6f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 1.199822 Sep 09 12:06:39.372000 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 29/60] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:38 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:40.138647 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:40.173545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f389a3d2-8893-493e-88b3-74251dd54d39 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 1.407017 Sep 09 12:06:40.174170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 32/61] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:38 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:40.398029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:40.399549 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:40.411413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:40.415786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:40.416774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:40.419965 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:40.421748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:40.433956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:40.909601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a333cb9-6ba2-4743-9f25-0858ad5bf059 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d9670dc0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:41.077433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a333cb9-6ba2-4743-9f25-0858ad5bf059 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/93892193-96c1-452d-95de-6836baf96a1f" status: 200 len: 348 microversion: 2.1 time: 0.171648 Sep 09 12:06:41.078473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 33/62] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:40 2022] GET /compute/v2.1/os-volumes/93892193-96c1-452d-95de-6836baf96a1f => generated 348 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:41.200292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:41.201112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:41.218616 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:41.219115 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:41.224378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:41.229258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:41.232108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:41.234351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:41.246402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=18 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:41.931470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:41.946587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34932e5e-3b96-49d2-b8f7-1c3e313b4220 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 1.553790 Sep 09 12:06:41.947715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 30/63] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:40 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:42.195003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b7bfd4a8-81a5-4f0b-baff-8e5ad2eee3a3 req-0d492a6d-568e-49b1-ba70-983c914152a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58b3ed3-4531-4074-9b0d-f23702ea7732", "tag": "ffea4dad-960c-42da-9277-9d5cf1331ade"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:42.264181 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bfd4a8-81a5-4f0b-baff-8e5ad2eee3a3 req-0d492a6d-568e-49b1-ba70-983c914152a0 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:42.271195 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bfd4a8-81a5-4f0b-baff-8e5ad2eee3a3 req-0d492a6d-568e-49b1-ba70-983c914152a0 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:42.273914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bfd4a8-81a5-4f0b-baff-8e5ad2eee3a3 req-0d492a6d-568e-49b1-ba70-983c914152a0 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:42.400810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b7bfd4a8-81a5-4f0b-baff-8e5ad2eee3a3 req-0d492a6d-568e-49b1-ba70-983c914152a0 service nova] Creating event network-changed:ffea4dad-960c-42da-9277-9d5cf1331ade for instance f58b3ed3-4531-4074-9b0d-f23702ea7732 on hv-cinder-85221 Sep 09 12:06:42.402832 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bfd4a8-81a5-4f0b-baff-8e5ad2eee3a3 req-0d492a6d-568e-49b1-ba70-983c914152a0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 12:06:42.408380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7bfd4a8-81a5-4f0b-baff-8e5ad2eee3a3 req-0d492a6d-568e-49b1-ba70-983c914152a0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 12:06:42.410897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:42.412866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:42.418479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:42.421715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:42.423014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:42.426208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:42.467971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.compute.rpcapi [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 12:06:42.472356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a232b9af-4649-4b87-9423-f143d44166af None None] Releasing lock "compute-rpcapi-router" {{(pid=120719) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 12:06:42.513671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a232b9af-4649-4b87-9423-f143d44166af None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.484147 Sep 09 12:06:42.515128 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 31/64] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:42.703143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:42.733115 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d193d340-62a9-4e82-a791-6477e4ab4412 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 1.530934 Sep 09 12:06:42.734666 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 34/65] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:41 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:42.974153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:42.975958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:43.006625 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:43.010241 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:43.010241 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:43.011227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:43.011227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:43.015003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:43.432392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7bf7cb5c-8226-4e69-9ec9-84f5706c0716 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d9772670>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:43.547634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7bf7cb5c-8226-4e69-9ec9-84f5706c0716 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/d10e64aa-26a7-4c7f-a518-20e2babbff09" status: 200 len: 351 microversion: 2.1 time: 0.120383 Sep 09 12:06:43.548978 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 35/66] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:43 2022] GET /compute/v2.1/os-volumes/d10e64aa-26a7-4c7f-a518-20e2babbff09 => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:43.574785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1450386786", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8739d8a-5ea8-482d-9e17-15514c43a160"}], "security_groups": [{"name": "tempest-securitygroup--379793282"}], "key_name": "tempest-keypair-927031755", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:44.252086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] validate_networks() for [('d8739d8a-5ea8-482d-9e17-15514c43a160', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:06:45.057676 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:45.069324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07ce9b28-1fa3-4b42-b40e-acd5a5fbc1e7 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 2.099442 Sep 09 12:06:45.069941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 32/67] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:42 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:45.074685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:45.075302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:45.083264 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:45.083749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:45.089352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:45.095420 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:45.096017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:45.096585 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:45.171702 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:06:45.172267 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:06:45.173383 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:06:45.174874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:06:45.175586 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:06:45.187693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:45.188498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:45.189137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:45.190258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:45.190916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:45.200130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:45.232722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for project 002ffc44d77748ae9c618229e21f41e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:45.239215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for user 9676597a1b884138bf5435f3b6cd63c1 and project 002ffc44d77748ae9c618229e21f41e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:45.254731 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:06:45.257695 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:06:45.309871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8214a18-f38e-45ab-8a0a-1b79e63200df tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.759516 Sep 09 12:06:45.318368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 36/68] 10.222.0.62 () {62 vars in 1188 bytes} [Fri Sep 9 12:06:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 12:06:45.324527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1806812308", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b586704-fa10-4a98-8c4c-8e20e534d239"}], "security_groups": [{"name": "tempest-securitygroup--581651278"}], "key_name": "tempest-keypair-1794773310", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:45.482398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] validate_networks() for [('6b586704-fa10-4a98-8c4c-8e20e534d239', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:06:45.502920 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:45.511267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a17a9044-0074-4b9a-9393-da4f3e1e48fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.440207 Sep 09 12:06:45.511854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 33/69] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:45 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:45.605070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-33876921-175e-4f30-a85b-69305dfa247e req-885b0502-c73c-4ccf-85f7-1a39982f7987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd9048c-290a-4f95-b832-04d69866e0ec", "tag": "cc41c44e-1bf1-41da-8d41-30c72060a07f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:45.624261 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-33876921-175e-4f30-a85b-69305dfa247e req-885b0502-c73c-4ccf-85f7-1a39982f7987 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:45.627872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-33876921-175e-4f30-a85b-69305dfa247e req-885b0502-c73c-4ccf-85f7-1a39982f7987 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:45.628349 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-33876921-175e-4f30-a85b-69305dfa247e req-885b0502-c73c-4ccf-85f7-1a39982f7987 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:45.670820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-33876921-175e-4f30-a85b-69305dfa247e req-885b0502-c73c-4ccf-85f7-1a39982f7987 service nova] Creating event network-changed:cc41c44e-1bf1-41da-8d41-30c72060a07f for instance fdd9048c-290a-4f95-b832-04d69866e0ec on hv-cinder-85221 Sep 09 12:06:45.678060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-33876921-175e-4f30-a85b-69305dfa247e req-885b0502-c73c-4ccf-85f7-1a39982f7987 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164875 Sep 09 12:06:45.678566 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 34/70] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:45.694410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-49ec9f7d-d3d0-474b-a3ea-98b821474d72 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:45.697501 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-49ec9f7d-d3d0-474b-a3ea-98b821474d72 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:45.766435 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:45.818537 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-49ec9f7d-d3d0-474b-a3ea-98b821474d72 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:45.826505 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-49ec9f7d-d3d0-474b-a3ea-98b821474d72 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:45.827951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-49ec9f7d-d3d0-474b-a3ea-98b821474d72 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:45.833935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-49ec9f7d-d3d0-474b-a3ea-98b821474d72 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1281 microversion: 2.20 time: 0.145474 Sep 09 12:06:45.835406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 35/71] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:45 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:46.105649 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:46.106547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:46.119613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.130885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.131440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:46.132200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.132670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.133096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:46.137005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:06:46.137421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:06:46.137885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:06:46.138316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:06:46.138722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:06:46.157045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.157945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.162057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:46.163242 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.163725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.164149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:46.247289 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:46.254312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for user bfc29d15a7344754aa53d55379e2751f and project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:46.277014 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:06:46.280125 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:06:46.436599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-321c6e4e-25f2-45de-b6d6-13f962c75a0e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.116984 Sep 09 12:06:46.437338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:06:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:06:46.456698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e102524-87af-42eb-8758-b9e36461e3c5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:46.457801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e102524-87af-42eb-8758-b9e36461e3c5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:46.480518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:46.493346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2308e9a8-c894-4bb0-bae5-ebbd736edb1a tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.399683 Sep 09 12:06:46.515531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 36/73] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:46 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:46.539005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:46.539930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:46.553216 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.558461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.576574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:46.580578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.582265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.584138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:46.598694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e102524-87af-42eb-8758-b9e36461e3c5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:46.608074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e102524-87af-42eb-8758-b9e36461e3c5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1238 microversion: 2.1 time: 0.155099 Sep 09 12:06:46.624053 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 38/74] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:46 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1238 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:46.661718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bba128ac-530e-4306-b85b-4943ed131523 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d96704c0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:46.758584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bba128ac-530e-4306-b85b-4943ed131523 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/24688cef-2dbc-4831-8aa9-3fbe684e997a" status: 200 len: 350 microversion: 2.1 time: 0.133212 Sep 09 12:06:46.760055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 39/75] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:06:46 2022] GET /compute/v2.1/os-volumes/24688cef-2dbc-4831-8aa9-3fbe684e997a => generated 350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:46.779062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bec804ed-e904-4066-8575-499199672a94 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d96f4ca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:46.943178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bec804ed-e904-4066-8575-499199672a94 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.169647 Sep 09 12:06:46.943975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 40/76] 10.222.0.62 () {58 vars in 1134 bytes} [Fri Sep 9 12:06:46 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:46.949275 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:46.950150 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:46.978802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.979588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.980235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:46.986143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:46.986861 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:46.987305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:47.149044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:47.165339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e82fb37a-ba11-4102-b244-b9ebc48d5975 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.633827 Sep 09 12:06:47.178786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 37/77] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:46 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:47.189896 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00082937-5c9a-457d-9ba1-4d3ea51c9d8e tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d961a1f0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:47.192920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:47.209812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:47.211295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:47.212996 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30282ac4-2ea6-4873-811a-a53e30c069db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1277 microversion: 2.20 time: 0.267408 Sep 09 12:06:47.213547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 41/78] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:46 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:47.219126 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-969038790", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846b424-a53d-4e1e-9d8f-617b0d2b2566"}], "security_groups": [{"name": "tempest-securitygroup--1636554791"}], "key_name": "tempest-keypair-1051219595", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:47.343701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00082937-5c9a-457d-9ba1-4d3ea51c9d8e tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.166814 Sep 09 12:06:47.344377 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 38/79] 10.222.0.62 () {58 vars in 1149 bytes} [Fri Sep 9 12:06:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:47.359715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da564eba-c0d1-4922-8457-0debee01ec87 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d9664790>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:47.384601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] validate_networks() for [('f846b424-a53d-4e1e-9d8f-617b0d2b2566', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:06:47.466614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da564eba-c0d1-4922-8457-0debee01ec87 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.111095 Sep 09 12:06:47.467195 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 39/80] 10.222.0.62 () {58 vars in 1134 bytes} [Fri Sep 9 12:06:47 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:47.481872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e1f2fe5-f7ba-4f5a-b4d5-25a935b86a40 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d961a5e0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:47.582076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e1f2fe5-f7ba-4f5a-b4d5-25a935b86a40 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104884 Sep 09 12:06:47.582704 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 40/81] 10.222.0.62 () {58 vars in 1167 bytes} [Fri Sep 9 12:06:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:47.588233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:47.589165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:47.609083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:47.614467 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:47.615495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:47.615667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:47.616472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:47.617119 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:47.617881 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:47.626906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=75 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:47.778031 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:47.787155 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a092d79-0526-49bc-82f9-628caea99b47 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.203012 Sep 09 12:06:47.787743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 41/82] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:47 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:47.809123 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9eca004b-4591-4b6f-a230-3e0a4fc6294c tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d961aaf0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:47.867923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:06:47.869523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:06:47.870671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:06:47.871085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:06:47.871500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:06:47.883141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:47.883631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:47.884092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:47.885041 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:47.885789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:47.886252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:47.893847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:47.901672 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9eca004b-4591-4b6f-a230-3e0a4fc6294c tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.101512 Sep 09 12:06:47.902415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 42/83] 10.222.0.62 () {58 vars in 1170 bytes} [Fri Sep 9 12:06:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:47.907717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:47.908323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:47.916779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:47.917492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:47.917924 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:47.918799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:47.919254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:47.919854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:47.921513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:06:47.926004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:06:47.939199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:06:47.941686 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:06:47.995420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f8cf76d-53e4-41ad-8156-28615b6e8665 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.780308 Sep 09 12:06:47.996631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 42/84] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:06:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:06:48.001958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-10279335-8b04-4d35-bdba-ff55082a80ec req-b35b341d-add0-4b69-a759-6e7fb13124c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e64b8c4-2489-4e97-89d1-d32f50da6e2c", "tag": "6642f427-f0da-4a1e-a58e-affddb81059d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:06:48.021684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:48.030667 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10279335-8b04-4d35-bdba-ff55082a80ec req-b35b341d-add0-4b69-a759-6e7fb13124c7 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.031194 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10279335-8b04-4d35-bdba-ff55082a80ec req-b35b341d-add0-4b69-a759-6e7fb13124c7 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.031738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10279335-8b04-4d35-bdba-ff55082a80ec req-b35b341d-add0-4b69-a759-6e7fb13124c7 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.032843 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65d03a5b-5173-40ce-9526-6d59e3f8677d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.128973 Sep 09 12:06:48.034519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 43/85] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:47 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:48.041069 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8071778b-62c4-4fa6-846b-b83ac7d7ef80 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d961ae50>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.073152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-10279335-8b04-4d35-bdba-ff55082a80ec req-b35b341d-add0-4b69-a759-6e7fb13124c7 service nova] Creating event network-changed:6642f427-f0da-4a1e-a58e-affddb81059d for instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c on hv-cinder-85221 Sep 09 12:06:48.073700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10279335-8b04-4d35-bdba-ff55082a80ec req-b35b341d-add0-4b69-a759-6e7fb13124c7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 09 12:06:48.074097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-10279335-8b04-4d35-bdba-ff55082a80ec req-b35b341d-add0-4b69-a759-6e7fb13124c7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 09 12:06:48.079956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.080808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.081260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.087874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.088607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.089207 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.101072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.compute.rpcapi [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 09 12:06:48.101994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] Releasing lock "compute-rpcapi-router" {{(pid=120720) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 09 12:06:48.127006 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8f5f4029-a835-4074-8086-078b9a33a10b None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128525 Sep 09 12:06:48.128399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 43/86] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:48.142481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8071778b-62c4-4fa6-846b-b83ac7d7ef80 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.103587 Sep 09 12:06:48.153193 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e928e5c3-5a3c-4f88-b4d7-f37a6f78dd42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.153193 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e928e5c3-5a3c-4f88-b4d7-f37a6f78dd42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:48.154684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 44/87] 10.222.0.62 () {58 vars in 1155 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:48.163054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75890343-65ff-4fda-81d6-3228fdcf60d6 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d9677160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.237887 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e928e5c3-5a3c-4f88-b4d7-f37a6f78dd42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:48.248917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e928e5c3-5a3c-4f88-b4d7-f37a6f78dd42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1241 microversion: 2.1 time: 0.113573 Sep 09 12:06:48.249486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 44/88] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:48.258483 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.258483 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:48.269872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.270414 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.270856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.271901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.272511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.272942 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.333293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75890343-65ff-4fda-81d6-3228fdcf60d6 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.176287 Sep 09 12:06:48.344472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 45/89] 10.222.0.62 () {58 vars in 1188 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:06:48.350882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.351749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:48.362854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.363544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.364191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.365022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.365558 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.366059 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.441193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:48.452861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:48.454638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:48.455948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43e20649-4b05-470a-9a62-341835d41485 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.110073 Sep 09 12:06:48.456984 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 46/90] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:48.461757 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4558d23f-9f41-4e7e-b444-c0cda6a7c9a5 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] Calling method '.version_select at 0x7ff2d9677160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.490989 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:48.503893 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-150dd930-5ce9-44d4-a7e8-eac5c7862a14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.252665 Sep 09 12:06:48.519325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 45/91] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:48.624807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4558d23f-9f41-4e7e-b444-c0cda6a7c9a5 tempest-VolumesTestJSON-1312700632 tempest-VolumesTestJSON-1312700632-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.166575 Sep 09 12:06:48.625407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 47/92] 10.222.0.62 () {58 vars in 1155 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:48.811949 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:48.812570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:48.818935 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.819826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.820458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.821134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:48.821629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:48.822062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:48.956467 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:48.965227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8452249c-89d8-4e73-b8d0-9de62373707d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.157189 Sep 09 12:06:48.965800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 46/93] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:48 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:49.058485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:49.059149 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:49.065078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.065565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.066005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.066731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.067227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.067660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.136074 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:49.145852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33f8251a-4c49-4a49-ad39-d6bac08501d4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.091643 Sep 09 12:06:49.146467 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 48/94] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:49 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:49.272164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:49.272778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:49.281259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.282135 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.282627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.283335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.283794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.284213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.352492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:49.360250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4823864-e544-45d5-84a9-8f0012a2b204 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.091970 Sep 09 12:06:49.360824 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 47/95] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:49 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:49.484951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:49.485687 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:49.492745 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.493314 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.493827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.494665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.495385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.495817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.531129 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:49.532259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:49.540284 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.541324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.541938 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.542843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:49.543764 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:49.544480 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:49.561218 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:49.570646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:49.572170 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:49.574722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b7464cd-54cd-4cd4-9ff1-31253113a1d8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.094187 Sep 09 12:06:49.575273 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 49/96] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:49 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:49.684449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:49.693078 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-275b5064-ab67-4b5c-a799-81d3c59c3fac tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.167245 Sep 09 12:06:49.693653 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 48/97] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:49 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:49.996597 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:49.997206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:50.003229 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.003715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.004156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.004847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.005299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.005721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.143164 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:50.153094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-189ff497-7005-42a9-b24f-819ae0972d9f tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.161411 Sep 09 12:06:50.153969 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 50/98] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:49 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:50.170529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:50.171256 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:50.178095 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.178632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.179161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.179917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.180372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.180897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.243622 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:50.251620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9159af22-1fd9-488f-b6e3-1ddd20773ce6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.086385 Sep 09 12:06:50.252187 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 49/99] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:50 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:50.384825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:50.386132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:50.392404 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.392928 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.393371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.394065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.394712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.395140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.477662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:50.485878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ceb69ff-490c-42ee-b8c9-c6b14988fa8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.105526 Sep 09 12:06:50.487633 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 51/100] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:50 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:50.600638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:50.601123 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:50.607997 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.608631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.609070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.609778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.610448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.610880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.684237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:50.696419 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:50.697826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:50.698980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ccff9332-a358-4dc2-8ed4-5917cdf2665e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.102750 Sep 09 12:06:50.699544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 50/101] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:50 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:50.719293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:50.719937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:50.725812 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.726338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.726781 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.727965 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:50.728431 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:50.728988 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:50.869604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:50.881134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5410c62-1f97-4148-89d9-534808151964 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.165669 Sep 09 12:06:50.881740 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 52/102] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:50 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:51.176170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:51.176801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:51.185325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.187569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.188056 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.188945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.189413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.189941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.275609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:51.276453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:51.282850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.283455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.284206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.284900 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.285582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.286106 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.325775 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:51.337477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b66f3b9-8cc6-4607-adda-9090ad82e1b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.165200 Sep 09 12:06:51.338259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 51/103] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:51 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:51.355286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:51.364084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3d75060-863d-4825-b3d8-acfd349bd30e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.092904 Sep 09 12:06:51.364847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 53/104] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:51 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:51.509835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:51.510466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:51.516395 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.516877 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.517317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.518012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.518502 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.518927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.586594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:51.594607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1784a0b7-5c77-46c7-b8bc-80740114cf1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.088428 Sep 09 12:06:51.598155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 52/105] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:51 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:51.724275 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:51.724735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:51.731591 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.732112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.732551 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.733255 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.733851 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.734315 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.797452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:51.806580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:51.808133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:51.809451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1219bcb3-1cef-4f9a-9840-0c77abee6608 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.089788 Sep 09 12:06:51.810011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 54/106] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:51 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:51.904135 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:51.904740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:51.913999 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.914348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.914787 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:51.915571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:51.915988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:51.916413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.059552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:52.067297 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fd0044c3-875f-4022-af9b-e5b35ddae87e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.166920 Sep 09 12:06:52.067854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 53/107] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:51 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:52.363340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:52.363340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:52.367074 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.367563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.368001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.369281 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.369739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.370453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.388707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:52.389324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:52.395218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.395703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.396133 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.396824 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.397279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.397704 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.462783 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:52.465258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:52.474016 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7515a8c-74d6-4f4d-8efd-542ed2b2c2e7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.088591 Sep 09 12:06:52.474848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 54/108] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:52 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:52.525353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:52.533169 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50aa614c-9947-45c7-ae87-134dbbad53b6 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.176851 Sep 09 12:06:52.533718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 55/109] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:52 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:52.617792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:52.618690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:52.624905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.625381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.625812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.626533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.626983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.627577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.695054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:52.702847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f425a3a-382d-4a58-9244-60c539341ba1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.088887 Sep 09 12:06:52.703418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 55/110] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:52 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:52.840230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:52.841490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:52.850981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.851755 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.853087 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.854258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:52.854850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:52.855558 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:52.929719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:52.938770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:52.940230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:52.941338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd7ca0e3-aef7-460e-99dc-e77e6366881b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.108775 Sep 09 12:06:52.941896 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 56/111] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:52 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:53.092591 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:53.093263 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:53.099160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.099819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.100256 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.100944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.101394 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.101816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.246347 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:53.256528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f05f1ba-47fc-4dd8-9653-090927fed1ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.165941 Sep 09 12:06:53.256528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 56/112] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:53 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:53.498550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:53.499166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:53.505163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.505652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.506084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.506799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.507258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.507867 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.557968 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:53.558652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:53.564776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.565288 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.565713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.566450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.566911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.567343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.575999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:53.583598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ca7c993-3966-474f-97de-f25347b108cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.089114 Sep 09 12:06:53.584511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 57/113] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:53 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:53.715793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:53.724484 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09fab4a0-d7a3-4deb-aa48-d7a7a4b74ddb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.171116 Sep 09 12:06:53.725258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 57/114] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:53 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:53.725384 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:53.726073 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:53.734332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.735019 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.735782 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.736680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.737063 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.737801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.824695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:53.832471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-76f3fff2-3ee0-4a5f-b0d9-749c6c08e541 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.110893 Sep 09 12:06:53.833047 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 58/115] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:53 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:53.966635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:53.967282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:53.973588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.974080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.974548 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:53.975254 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:53.975712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:53.976135 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.068184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:54.076542 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:54.078031 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:54.079223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4e7208ba-a435-47d2-b480-74abac6c79b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.116462 Sep 09 12:06:54.079792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 58/116] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:53 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:54.277324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:54.277936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:54.284070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.284558 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.284993 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.285686 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.286161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.286586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.427679 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:54.436543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-49d946bf-4692-414a-b9f3-f3c2f67db968 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.163612 Sep 09 12:06:54.437312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 59/117] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:54 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:54.608523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:54.609134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:54.615316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.615795 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.616225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.616912 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.617358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.617776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.683054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:54.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a177df4-e3b5-44e3-b051-88117752af19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.086765 Sep 09 12:06:54.692110 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 59/118] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:54 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:54.749068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:54.749778 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:54.755789 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.756363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.756874 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.757641 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.758214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.759187 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.855438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:54.856404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:54.862412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.863095 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.864233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.864692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:54.865348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:54.866190 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:54.894881 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:54.903803 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6633e0e9-8eec-4132-bdba-56b540a9fb25 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.158734 Sep 09 12:06:54.904382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 60/119] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:54 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:54.936112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:54.938448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:54.945253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec57f374-482b-433b-9398-0b6b4f1c8cfd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.094654 Sep 09 12:06:54.945828 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 60/120] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:54 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:55.104056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:55.104707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:55.110720 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.111202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.111637 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.112317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.112766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.113182 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.178088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:55.181216 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:55.190040 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:55.191932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:55.193256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c9a4725-c551-4f08-9571-0c743cd1f05c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.093115 Sep 09 12:06:55.194003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 61/121] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:55 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:55.460503 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:55.461117 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:55.467826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.468797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.469063 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.469972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.470463 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.470892 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.607104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:55.614608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09a92161-08ba-47d8-a90f-da0df89d9053 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.157857 Sep 09 12:06:55.615834 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 61/122] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:55 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:55.722391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:55.723317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:55.729363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.729951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.730491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.731515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.732324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.732880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.825178 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:55.843979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:55.853344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca6afb05-f5f0-45a5-b7cf-b42a00938a54 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.136360 Sep 09 12:06:55.853935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 62/123] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:55 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:55.926170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:55.927118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:55.934457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.934946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.935586 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.936441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.937050 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.937621 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.968685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:55.969428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:55.975304 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.975784 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.976221 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:55.976911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:55.977911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:55.978357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:56.044941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:56.052604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b398f1a8-aa42-463a-9f52-abc8540469c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.087681 Sep 09 12:06:56.053389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 63/124] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:55 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:56.189576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:56.197526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29320311-5a6a-40ac-a8c3-ddad863fc339 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.275248 Sep 09 12:06:56.198364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 62/125] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:55 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:56.218049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:56.221743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:56.229058 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:56.229950 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:56.230862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:56.231479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:56.232005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:56.232487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:56.330169 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:56.343907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:56.345709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:56.346961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed251df7-d90a-4c97-aaad-35ce65e6bc65 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.132755 Sep 09 12:06:56.347671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 64/126] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:56 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:56.641201 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:56.642035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:56.652237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:56.652237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:56.652237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:56.652237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:56.652597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:56.652597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:56.817384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:56.825778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6160e82b-4b8d-488f-abc7-0fd23f92b770 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.189821 Sep 09 12:06:56.826469 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 63/127] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:56 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:56.879457 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:56.880077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:56.886502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:56.887058 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:56.887602 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:56.888311 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:56.888771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:56.889208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:56.952809 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:56.961085 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3938983-b1a9-4aab-a395-3709f27a6376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1242 microversion: 2.1 time: 0.085537 Sep 09 12:06:56.961700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 65/128] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:56 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:57.076498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:57.077108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:57.083144 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.083625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.084054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:57.084746 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.085192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.085609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:57.192095 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:57.211236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d434541b-bbeb-492a-a665-e08df8fcab12 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1245 microversion: 2.1 time: 0.138638 Sep 09 12:06:57.211832 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 64/129] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:57 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:57.223260 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:57.223880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:57.233077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.233712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.234512 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:57.235692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.236244 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.236835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:57.376277 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:57.378636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:57.395111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.399249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.399806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:57.400869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.406373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.407002 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:57.526808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:57.535573 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:57.537016 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:57.538142 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-250e3728-7728-41ae-a4bc-e1ce5c4a7906 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1333 microversion: 2.20 time: 0.168557 Sep 09 12:06:57.538698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 65/130] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:57 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1333 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:06:57.848985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:57.850155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:57.858486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.865861 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.866432 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:57.867285 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:57.867770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:57.868734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:58.027639 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:58.036712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4fd932f7-6c6c-4f9e-85ca-303f0a85fc8b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.817904 Sep 09 12:06:58.043272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 66/131] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:57 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:58.047985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:58.048603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:58.067326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:58.068023 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:58.068611 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:58.069471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:58.070082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:58.070713 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:58.100057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:58.211452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:58.223136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c7674bc3-aa32-41ce-846f-e3c2233b896f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1234 microversion: 2.1 time: 0.178558 Sep 09 12:06:58.223650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 67/132] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:58 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1234 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:58.241917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=26 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:06:58.248225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:58.249559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:58.258331 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:58.260649 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:58.261289 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:58.262014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:58.262498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:58.262642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:58.262923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:58.275943 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1c40b32-2271-4e32-8935-870fb2842e99 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.429274 Sep 09 12:06:58.294351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 66/133] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:57 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:58.361632 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:58.370804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-35fa9c04-59d8-4a83-b736-3c97692175a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1237 microversion: 2.1 time: 0.130153 Sep 09 12:06:58.372600 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 68/134] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:58 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1237 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:06:58.563109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:58.563984 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:58.570881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:58.571957 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:58.572387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:58.573088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:58.574281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:58.574717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:58.667447 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:58.682280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:58.684257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:58.686075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f9e2a0b-f991-46f9-b170-08b5c8640c35 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1341 microversion: 2.20 time: 0.127505 Sep 09 12:06:58.687152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 67/135] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:58 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1341 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:06:59.065154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:59.065777 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:59.074011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.075018 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.075464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.076273 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.076947 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.077453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.246903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:59.254870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7489d23d-67b2-49bc-aee7-259af4e379e2 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.193886 Sep 09 12:06:59.255705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 69/136] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:59 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:59.256584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:59.257443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:59.264257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.265308 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.265903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.267010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.267619 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.268198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.298837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:59.299559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:59.307578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.308053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.308494 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.309207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.310310 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.335453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:59.348535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77f6254d-6d62-499d-abab-7c4590f81c36 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1290 microversion: 2.1 time: 0.092652 Sep 09 12:06:59.348535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 68/137] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:59 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:59.399609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:59.400409 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:59.406817 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.407374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.407814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.408839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.409300 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.409720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.468944 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:59.477358 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6330aef6-7968-4c88-963b-e00d6167aa53 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.182796 Sep 09 12:06:59.478479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 70/138] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:59 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:59.487982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:59.499759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-66a7f0bc-8f51-453f-b9a7-4543f8c2deab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1237 microversion: 2.1 time: 0.104812 Sep 09 12:06:59.508821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 69/139] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:06:59 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:06:59.712751 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:06:59.713360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:06:59.722456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.722456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.722456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.722456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:06:59.722719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:06:59.722719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:06:59.811779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:59.820211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:59.822472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:06:59.823899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d34b71e-5dd8-450d-a620-069f1469fcb8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1341 microversion: 2.20 time: 0.115715 Sep 09 12:06:59.824903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 71/140] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:06:59 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1341 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:00.280047 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:00.281405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:00.299017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.299660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.300244 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.301084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.312699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.315477 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.322535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5840499a-72e4-4b8c-aa71-eed9232d15dc req-d0e300a9-2831-4ea5-81da-8a9dfcf61b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58b3ed3-4531-4074-9b0d-f23702ea7732", "name": "network-vif-plugged", "status": "completed", "tag": "ffea4dad-960c-42da-9277-9d5cf1331ade"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:00.341741 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5840499a-72e4-4b8c-aa71-eed9232d15dc req-d0e300a9-2831-4ea5-81da-8a9dfcf61b4f service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.342239 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5840499a-72e4-4b8c-aa71-eed9232d15dc req-d0e300a9-2831-4ea5-81da-8a9dfcf61b4f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.342708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5840499a-72e4-4b8c-aa71-eed9232d15dc req-d0e300a9-2831-4ea5-81da-8a9dfcf61b4f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.376038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5840499a-72e4-4b8c-aa71-eed9232d15dc req-d0e300a9-2831-4ea5-81da-8a9dfcf61b4f service nova] Creating event network-vif-plugged:ffea4dad-960c-42da-9277-9d5cf1331ade for instance f58b3ed3-4531-4074-9b0d-f23702ea7732 on hv-cinder-85221 Sep 09 12:07:00.382738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5840499a-72e4-4b8c-aa71-eed9232d15dc req-d0e300a9-2831-4ea5-81da-8a9dfcf61b4f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167108 Sep 09 12:07:00.387237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 70/141] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:00.395383 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:00.401875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:00.419213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.419779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.420281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.423169 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.423747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.424944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.723798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:00.737415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25c7e9a5-921d-4f42-b333-dcfb441d8596 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1290 microversion: 2.1 time: 0.346738 Sep 09 12:07:00.738011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 71/142] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:00 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1290 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:00.763348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:00.767388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:00.770807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:00.775326 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.776059 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.776770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.777666 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.778760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.779466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.784398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:00.799083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1d02d0b2-90bf-47d9-a462-319f74bcae4d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.525254 Sep 09 12:07:00.800021 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 72/143] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:00 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:00.813287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:00.814670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:00.836047 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.837054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.837565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.838435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:00.838891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:00.839314 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:00.991806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:01.007165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-33d1ca03-788b-4e49-8b4f-e50d905f2d7f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1237 microversion: 2.1 time: 0.199242 Sep 09 12:07:01.008353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 73/144] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:00 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1237 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:01.028574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:01.029206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:01.040478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:01.043142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:01.043982 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:01.045982 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:01.047532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:01.049243 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:01.139365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:01.149457 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:01.151399 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:01.152930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e7610aa-e75d-4606-b331-56984d2596a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1339 microversion: 2.20 time: 0.142329 Sep 09 12:07:01.155650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 74/145] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:01 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:01.158543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:01.171322 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8ee48f5-2d59-4799-bdb0-c4b8abff906e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.415713 Sep 09 12:07:01.172487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 72/146] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:00 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:01.760191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:01.760825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:01.766709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:01.767184 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:01.767612 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:01.768284 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:01.768730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:01.769146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:01.822629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:01.823223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:01.829312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:01.829797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:01.830273 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:01.831694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:01.832153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:01.832577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:01.833030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:01.841130 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b1af027-d13c-402f-8501-49fc1a7cf2ca tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1290 microversion: 2.1 time: 0.084757 Sep 09 12:07:01.841697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 75/147] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:01 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:01.969501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:01.978334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0c96a754-1308-424a-8060-8c35891751a0 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.159493 Sep 09 12:07:01.979757 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 73/148] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:01 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:02.035203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:02.036193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:02.049733 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.050977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.051701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.053633 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.054594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.055505 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.156828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:02.168113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2ab4313e-a730-4315-aef2-81313c481b1b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1237 microversion: 2.1 time: 0.140378 Sep 09 12:07:02.169804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 76/149] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:02 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:02.192568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:02.193500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:02.196346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:02.197206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:02.201176 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.201956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.202564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.203826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.204585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.204861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.205051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.205503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.205997 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.206797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.207255 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.207727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.327888 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:02.340196 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:02.343089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:02.344452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0e6795ac-4511-49fc-8de3-3dfb743839ef tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1339 microversion: 2.20 time: 0.157413 Sep 09 12:07:02.358141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 74/150] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:02 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1339 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:02.391828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:02.400057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4bed4388-b1d6-44ef-8978-84761c199dad tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.208152 Sep 09 12:07:02.400615 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 77/151] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:02 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:02.864544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:02.865148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:02.871424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.871896 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.872327 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.873000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:02.873448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:02.873862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:02.937116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:02.944703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4500113b-63ad-4542-9188-a33bed35b857 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1290 microversion: 2.1 time: 0.083951 Sep 09 12:07:02.945260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 75/152] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:02 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:03.004146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:03.004757 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:03.012435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.012926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.013365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.014068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.014562 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.014990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.031362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:03.156189 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:03.163836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7cfdbcf2-f335-4e98-a506-3b8a6807e567 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.163555 Sep 09 12:07:03.164398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 78/153] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:02 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:03.194496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:03.195097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:03.201193 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.201671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.202097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.202804 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.203251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.203668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.265372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:03.272951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-be9740db-a8d5-40b0-bc28-4460c77afed6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1237 microversion: 2.1 time: 0.083446 Sep 09 12:07:03.273506 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 76/154] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:03 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:03.369746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:03.370642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:03.376657 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.377143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.377578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.378297 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.378750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.379172 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.425735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:03.426742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:03.437391 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.438666 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.441215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.442203 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.442832 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.445272 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.573119 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:03.581302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:03.582975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:03.584273 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fd8d665-81e9-4d4a-88a3-b917519acdb5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1339 microversion: 2.20 time: 0.218586 Sep 09 12:07:03.585386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 79/155] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:03 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1339 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:03.734635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:03.746608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d7ed6fa-10f7-4f80-a276-3a24b086fab9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.325315 Sep 09 12:07:03.748005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 77/156] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:03 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:03.970380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:03.972166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:03.979698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.980322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.980768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:03.981750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:03.981934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:03.983460 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.062387 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:04.079287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b39eb08d-ffac-462f-9aa5-3074492dd7cd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1298 microversion: 2.1 time: 0.113342 Sep 09 12:07:04.080475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 80/157] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:03 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:04.187148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:04.188527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:04.197190 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.200691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.201618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.202681 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.203570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.204209 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.234218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:04.296138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:04.297060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:04.305175 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.305714 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.306299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.307209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.308239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.309101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.383836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:04.392130 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-de924f23-d67b-44d9-b827-8ea3e34a5386 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.100027 Sep 09 12:07:04.392719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 81/158] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:04 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:04.397147 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-26b903e7-fa7e-48d8-a53e-949775faf8b8 req-9941d7a3-13f7-4998-a998-cbec0645edbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e64b8c4-2489-4e97-89d1-d32f50da6e2c", "name": "network-vif-plugged", "status": "completed", "tag": "6642f427-f0da-4a1e-a58e-affddb81059d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:04.414226 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-26b903e7-fa7e-48d8-a53e-949775faf8b8 req-9941d7a3-13f7-4998-a998-cbec0645edbe service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.414867 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-26b903e7-fa7e-48d8-a53e-949775faf8b8 req-9941d7a3-13f7-4998-a998-cbec0645edbe service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.415939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-26b903e7-fa7e-48d8-a53e-949775faf8b8 req-9941d7a3-13f7-4998-a998-cbec0645edbe service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.433727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-26b903e7-fa7e-48d8-a53e-949775faf8b8 req-9941d7a3-13f7-4998-a998-cbec0645edbe service nova] Creating event network-vif-plugged:6642f427-f0da-4a1e-a58e-affddb81059d for instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c on hv-cinder-85221 Sep 09 12:07:04.441650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-26b903e7-fa7e-48d8-a53e-949775faf8b8 req-9941d7a3-13f7-4998-a998-cbec0645edbe service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047463 Sep 09 12:07:04.442894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 82/159] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:04.452311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:04.461057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f141e048-5aa8-450f-b4cc-2d6fa7bdc583 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.278182 Sep 09 12:07:04.462226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 78/160] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:04 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:04.609228 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:04.610024 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:04.616106 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.616579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.617003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.618208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.618660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.619493 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.754654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:04.764544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:04.766362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:04.767482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5f67be4a-4367-4058-b640-fd1aae8ca99d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.162465 Sep 09 12:07:04.768029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 83/161] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:04 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:04.770097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:04.770728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:04.778764 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.779503 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.780153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.781198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:04.781892 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:04.782582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:04.914323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:04.922386 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-48bb8729-0813-41ac-9ed4-db91916376f3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.156116 Sep 09 12:07:04.922944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 79/162] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:04 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:05.104613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:05.105218 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:05.111179 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.111654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.112081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.112761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.113211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.113630 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.176831 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:05.185143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9b933015-793c-4a53-b7ec-20762aedd694 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1298 microversion: 2.1 time: 0.084861 Sep 09 12:07:05.185700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 84/163] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:05 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:05.418613 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:05.419171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:05.425093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.425575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.426011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.426729 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.427184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.427610 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.488877 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:05.489042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:05.489496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:05.495880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.496365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.496801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.496921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67d253de-87bb-48a6-af95-06bfa5e5b633 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.082818 Sep 09 12:07:05.497676 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 80/164] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:05 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:05.497784 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.497928 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.498455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.630761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:05.638950 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9373aa9c-d50e-4fdb-96db-d637ed5b9fa4 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.153885 Sep 09 12:07:05.639517 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 85/165] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:05 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:05.799195 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:05.800009 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:05.806456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.806947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.807382 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.808080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.808535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.808965 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.941075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:05.945315 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:05.946550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:05.949848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:05.951333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:05.952457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-629cb4e6-d56e-485f-9165-26df4000cbb6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.161497 Sep 09 12:07:05.952612 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.953019 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 81/166] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:05 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:05.953127 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.953854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:05.954566 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:05.955077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:05.955497 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.084525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:06.092212 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8252bee9-41f9-4a27-a5d9-474713795e82 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.151033 Sep 09 12:07:06.092772 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 86/167] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:05 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:06.208808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:06.209418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:06.215873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.216350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.216781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.217466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.217915 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.218377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.287714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:06.295260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-545c70d6-9461-4ba8-957e-0a69a6595d0f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1298 microversion: 2.1 time: 0.090292 Sep 09 12:07:06.295833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 82/168] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:06 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:06.519572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:06.520174 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:06.526142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.526639 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.527068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.527850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.528296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.528712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.589253 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:06.596842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4cf695ca-12b2-4b14-943a-0329babb1edc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.081113 Sep 09 12:07:06.597405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 87/169] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:06 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:06.663825 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:06.664471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:06.670655 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.670875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.671312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.672004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.672460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.672885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.811450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:06.818977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1b74c5e-d145-42ee-8b1d-5d60ff3b758c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.159158 Sep 09 12:07:06.819538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 83/170] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:06 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:06.976979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:06.977504 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:06.983542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.984027 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.984467 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:06.985151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:06.985604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:06.986035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.113795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:07.114726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:07.115341 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:07.122212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.122703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.123138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.123842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.124293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.124708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.125083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:07.126572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:07.127707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8503b23f-1810-4ac9-b517-c273ad28dd66 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.154717 Sep 09 12:07:07.130641 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 88/171] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:06 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:07.260344 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:07.268158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9ac1ab1-9dd3-4aa3-90b0-0780bd35c9df tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.157338 Sep 09 12:07:07.268724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 84/172] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:07 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:07.318477 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:07.319096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:07.325213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.325699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.326341 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.326848 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.327304 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.327730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.389250 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:07.396917 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6280f54e-1886-40c2-bdf4-e09eef812d7c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1298 microversion: 2.1 time: 0.082242 Sep 09 12:07:07.397496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 89/173] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:07 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1298 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:07.621406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:07.622004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:07.628422 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.628937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.629368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.630062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.630543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.630970 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.695427 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:07.704876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c9b8290-6065-4362-8936-241c1f59dac8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.087968 Sep 09 12:07:07.705605 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 85/174] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:07 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:07.843405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:07.844018 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:07.862069 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.863593 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.864365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:07.866077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:07.868876 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:07.869644 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.093348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:08.102391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96421870-5846-4947-b00d-827482dd6989 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.263137 Sep 09 12:07:08.108553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 90/175] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:07 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:08.157170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:08.157766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:08.167268 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.168438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.170048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.170791 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.171248 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.171665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.290785 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:08.291397 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:08.298646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.299271 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.299707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.300706 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.301412 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.302628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.457731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:08.465430 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e301717b-5111-4bcc-83e5-f307de6b3888 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.178713 Sep 09 12:07:08.465992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 91/176] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:08 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:08.470629 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:08.471295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:08.477337 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:08.485082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.485654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.486189 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.486292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:08.486981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.487519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.487984 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:08.488184 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.489162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3b2c830e-db22-4e1b-8b82-32b007b58ee5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.336102 Sep 09 12:07:08.489942 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 86/177] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:08 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:08.685328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:08.697078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0ace62c-d068-4123-86bf-209fee0458b4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1308 microversion: 2.1 time: 0.229706 Sep 09 12:07:08.698323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 92/178] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:08 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:08.730688 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:08.731317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:08.737591 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.738106 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.738569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.739267 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.740063 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.740581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.752555 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-fd18a05d-fe40-4364-9510-83db95d37b22 req-f8d22dfc-c9f7-46ce-a005-876c2507f507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214a4341-91a9-4b8e-b1db-4e07620cfbf7", "tag": "5d843f0d-cb60-459b-ab64-c48fbc48049a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:08.767028 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fd18a05d-fe40-4364-9510-83db95d37b22 req-f8d22dfc-c9f7-46ce-a005-876c2507f507 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:08.768053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fd18a05d-fe40-4364-9510-83db95d37b22 req-f8d22dfc-c9f7-46ce-a005-876c2507f507 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:08.768638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-fd18a05d-fe40-4364-9510-83db95d37b22 req-f8d22dfc-c9f7-46ce-a005-876c2507f507 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:08.790964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-fd18a05d-fe40-4364-9510-83db95d37b22 req-f8d22dfc-c9f7-46ce-a005-876c2507f507 service nova] Creating event network-changed:5d843f0d-cb60-459b-ab64-c48fbc48049a for instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 on hv-cinder-85221 Sep 09 12:07:08.797412 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-fd18a05d-fe40-4364-9510-83db95d37b22 req-f8d22dfc-c9f7-46ce-a005-876c2507f507 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051332 Sep 09 12:07:08.798582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 93/179] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:07:08.841442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:08.849213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6b9bd428-8249-4064-9dc9-586e1c86320c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.123931 Sep 09 12:07:08.850129 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 87/180] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:08 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:09.125787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:09.126509 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:09.133321 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.133808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.134278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.134960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.135411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.135892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.270211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:09.278581 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-47406151-2d1d-4915-a102-dae03e9d356d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.157097 Sep 09 12:07:09.279180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 94/181] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:09 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:09.488217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:09.488833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:09.494828 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.495571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.496005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.496694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.497151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.497581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.517805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:09.518442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:09.521422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:09.525700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.526251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.526774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.527486 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.527944 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.528366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.666028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:09.675307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c269c82a-6718-43f6-94fd-9a3a857958b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.190742 Sep 09 12:07:09.676116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 88/182] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:09 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:09.686447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:09.699877 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:09.701432 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:09.702668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bcdf1d25-b7f1-42f0-a769-268c87c6a92e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.189802 Sep 09 12:07:09.703335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 95/183] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:09 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:09.722230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:09.722845 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:09.728938 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.729355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.729789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.730514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.730972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.731530 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.796972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:09.804916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-27e6d598-3af5-4742-8b93-ee596d76ae5b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1296 microversion: 2.1 time: 0.086438 Sep 09 12:07:09.806026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 89/184] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:09 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:09.873133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:09.873750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:09.879700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.880181 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.880647 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.881308 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:09.881766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:09.882254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:09.898083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:09.948052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:09.955797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96d3044e-8fd8-4952-9b62-b3b2469587e5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.086792 Sep 09 12:07:09.956361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 96/185] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:09 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:10.300957 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:10.301683 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:10.309000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.309545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.309933 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.310665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.311124 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.311587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.436605 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:10.444377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-976f0838-d7aa-4808-829d-2279e880ceee tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.147407 Sep 09 12:07:10.444945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 90/186] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:10 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:10.698005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:10.698655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:10.704769 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.705254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.705681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.706400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.706848 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.707263 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.730088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:10.731212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:10.740131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.740914 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.741424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.742362 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.743538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.744036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.875080 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:10.882842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c803328-5e87-4212-9fee-4ad51815fe61 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.188622 Sep 09 12:07:10.884141 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 97/187] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:10 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:10.889297 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:10.892948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:10.892948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:10.899443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.899677 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:10.899990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.900451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.901109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:10.901215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.901600 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.902019 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.902287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5dc8d5b-7ec6-4374-a9a4-96e2866c9319 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.177732 Sep 09 12:07:10.903126 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 91/188] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:10 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:10.962609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:10.970157 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2fa57e4c-8390-4797-b0e0-26d7afa22bef tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1296 microversion: 2.1 time: 0.082643 Sep 09 12:07:10.970728 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 98/189] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:10 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:10.978158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:10.978766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:10.984644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.985116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.985544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:10.986249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:10.986696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:10.987107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:11.052200 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:11.060325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2a55e6b8-da48-4da0-8236-c05e405d01e3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.085964 Sep 09 12:07:11.060885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 92/190] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:10 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:11.468219 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:11.468749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:11.474902 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:11.475388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:11.475826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:11.476512 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:11.477662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:11.478087 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:11.608476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:11.616122 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e88a4bbb-4cef-426f-a25a-0e1901feee29 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.151878 Sep 09 12:07:11.616692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 99/191] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:11 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:11.906166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:11.906786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:11.912873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:11.913359 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:11.913796 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:11.914510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:11.914967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:11.915401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:11.927011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:11.927621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:11.933547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:11.934037 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:11.934513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:11.935200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:11.935661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:11.936087 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:12.047058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:12.054799 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-113fcdc2-0a9d-4198-b2bb-30edbf2cf1a9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.152620 Sep 09 12:07:12.056081 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 93/192] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:11 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:12.066221 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:12.066221 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:12.067475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:12.067966 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:12.068398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:12.069081 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:12.069531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:12.070133 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:12.071146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:12.080086 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:12.081503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:12.082640 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ebecb14-65c3-4b38-a74d-3706f432ce6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.159520 Sep 09 12:07:12.083186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 100/193] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:11 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:12.087727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:12.088325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:12.094041 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:12.094589 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:12.095034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:12.095715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:12.096161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:12.096576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:12.135342 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:12.137546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:12.146023 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf6165f8-41fc-4a56-8879-47ce62480075 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1296 microversion: 2.1 time: 0.088381 Sep 09 12:07:12.147122 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 94/194] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:12 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:12.162911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:12.170920 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54ffc448-af7c-4f0d-b5c2-0039af4bf409 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.086641 Sep 09 12:07:12.171495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 101/195] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:12 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:12.638857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:12.639465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:12.646547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:12.646978 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:12.647417 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:12.648104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:12.648557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:12.648982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:12.772704 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:12.780896 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c5dab353-59aa-4215-b7f1-f385ac15cf93 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.145897 Sep 09 12:07:12.781468 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 95/196] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:12 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:13.079083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:13.079688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:13.085699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.086718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.087157 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.087836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.088283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.088702 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.109304 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:13.110539 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:13.120455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.121366 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.121994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.123607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.124160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.124663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.405550 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:13.416720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:13.418608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:13.419859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-47de992d-81e8-4b1b-89f7-c0ff8e219556 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.315192 Sep 09 12:07:13.420820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 96/197] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:13 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:13.425578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:13.426322 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:13.436223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.436894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.437500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.438436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.438891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.439316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.513642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:13.526144 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92bab660-7e5b-492b-ad6f-189c91056844 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1296 microversion: 2.1 time: 0.103718 Sep 09 12:07:13.527659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 97/198] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:13 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:13.535296 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:13.535658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:13.544186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.544678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.545939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.546279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.546735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.547157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.622680 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:13.632286 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0b434bec-9215-40c3-9564-af4ae4056f32 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.102915 Sep 09 12:07:13.633153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 98/199] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:13 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:13.647780 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:13.647990 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-fff849a7-c828-42a0-b2a6-d060710d5458 req-63cde3ab-7be2-45b5-8ac6-da000daa4151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd9048c-290a-4f95-b832-04d69866e0ec", "name": "network-vif-plugged", "status": "completed", "tag": "cc41c44e-1bf1-41da-8d41-30c72060a07f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:13.659975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e28ce93-41da-4bf2-8d50-1c8baaf2a405 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.584580 Sep 09 12:07:13.670356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fff849a7-c828-42a0-b2a6-d060710d5458 req-63cde3ab-7be2-45b5-8ac6-da000daa4151 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.670356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fff849a7-c828-42a0-b2a6-d060710d5458 req-63cde3ab-7be2-45b5-8ac6-da000daa4151 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.670356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-fff849a7-c828-42a0-b2a6-d060710d5458 req-63cde3ab-7be2-45b5-8ac6-da000daa4151 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.670903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 102/200] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:13 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:13.685702 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-fff849a7-c828-42a0-b2a6-d060710d5458 req-63cde3ab-7be2-45b5-8ac6-da000daa4151 service nova] Creating event network-vif-plugged:cc41c44e-1bf1-41da-8d41-30c72060a07f for instance fdd9048c-290a-4f95-b832-04d69866e0ec on hv-cinder-85221 Sep 09 12:07:13.692937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-fff849a7-c828-42a0-b2a6-d060710d5458 req-63cde3ab-7be2-45b5-8ac6-da000daa4151 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058156 Sep 09 12:07:13.693830 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 99/201] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:13.803449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:13.804061 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:13.810030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.810636 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.811094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:13.811762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:13.812218 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:13.812641 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.050866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:14.058489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e9deee47-ff45-4ad2-9888-f0909cb22d4c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.258764 Sep 09 12:07:14.059392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 103/202] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:13 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:14.455908 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:14.456749 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:14.463827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.464316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.464750 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.465445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.465905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.466356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.552407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:14.553767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:14.561736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.562817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.563539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.564658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.565419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.567132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.762661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:14.786150 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:14.787917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:14.790402 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e2b60750-2ac0-4c9a-affb-95963b79bf46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.337587 Sep 09 12:07:14.809834 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 100/203] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:14 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:14.814738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:14.815358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:14.821478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.822315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.822760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.823481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.823934 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.824364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.964264 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:14.973600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31341f6a-c3fb-45eb-8b34-eda96375c56b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1293 microversion: 2.1 time: 0.161677 Sep 09 12:07:14.973928 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 101/204] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:14 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:14.979213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:14.980138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:14.991947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.993135 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.993591 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:14.994409 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:14.994877 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:14.995563 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:15.053578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:15.062680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10402765-89c5-4b31-a551-fa9974ad4292 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.515264 Sep 09 12:07:15.063885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 104/205] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:14 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:15.091049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:15.092003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:15.104180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:15.105073 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:15.105681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:15.111239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:15.111755 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:15.112239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:15.209431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:15.218333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f76ca834-af3f-4152-9138-2e433daa11d5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.243340 Sep 09 12:07:15.219862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 102/206] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:14 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:15.518953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:15.530849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-79b5bc15-2204-4ecb-9322-d1b3ef6867b5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.450986 Sep 09 12:07:15.532309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 105/207] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:15 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:15.816758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:15.817347 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:15.826052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:15.832054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:15.832911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:15.833824 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:15.834801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:15.835593 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:15.998425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:15.999044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:16.016707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.017450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.018071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.019035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.019715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.020520 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.038700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:16.051469 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:16.053356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:16.055361 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70ad733a-168b-41eb-bddb-ce2203ed2a02 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.241875 Sep 09 12:07:16.056320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 103/208] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:15 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:16.095764 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:16.096551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:16.107290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.108579 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.109155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.110270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.111044 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.111538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.145614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:16.161731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c82a87b-778d-4740-b183-f3fb49e58008 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1301 microversion: 2.1 time: 0.168513 Sep 09 12:07:16.162759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 106/209] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:15 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:16.168521 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8e645499-2892-4024-8ec2-725c400b0193 req-533b2f4e-9599-4eeb-9d68-a1ed2ff708ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00de6121-bfa1-4888-af77-69a8f8800324", "tag": "fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:16.192085 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8e645499-2892-4024-8ec2-725c400b0193 req-533b2f4e-9599-4eeb-9d68-a1ed2ff708ec service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.192997 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8e645499-2892-4024-8ec2-725c400b0193 req-533b2f4e-9599-4eeb-9d68-a1ed2ff708ec service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.212346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8e645499-2892-4024-8ec2-725c400b0193 req-533b2f4e-9599-4eeb-9d68-a1ed2ff708ec service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.244203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8e645499-2892-4024-8ec2-725c400b0193 req-533b2f4e-9599-4eeb-9d68-a1ed2ff708ec service nova] Creating event network-changed:fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632 for instance 00de6121-bfa1-4888-af77-69a8f8800324 on hv-cinder-85221 Sep 09 12:07:16.260034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8e645499-2892-4024-8ec2-725c400b0193 req-533b2f4e-9599-4eeb-9d68-a1ed2ff708ec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095809 Sep 09 12:07:16.270724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 107/210] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:16.275264 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:16.276183 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:16.293412 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.295114 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.297064 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.298072 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.299187 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.301048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.334258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:16.344551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00f8cb89-7acf-4c5f-a6c3-c40c74bf60d7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.259551 Sep 09 12:07:16.348003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 104/211] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:16 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:16.555946 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:16.564997 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25e7234c-2a4c-4c3e-9a69-94b3c493dd32 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1321 microversion: 2.1 time: 0.298503 Sep 09 12:07:16.567789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:16.568641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:16.581624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.582510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.583085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.583919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:16.584477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:16.585482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:16.587080 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 108/212] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:16 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:16.742759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:16.751738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d56de64-ff1b-4607-b4a6-aaf7cdb80409 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.189276 Sep 09 12:07:16.752707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 105/213] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:16 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:17.080645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:17.081338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:17.088330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.088882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.089449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.090224 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.090757 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.091248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.193104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:17.194411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:17.207102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.208529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.209338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.211001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.212693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.213292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.252128 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:17.265159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:17.267384 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:17.268744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68974033-5f1a-4ae2-be2c-a91694360c64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.192003 Sep 09 12:07:17.269831 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 109/214] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:17 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:17.290423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:17.300041 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-306da710-a3c6-4384-9aa8-93386b43c983 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1299 microversion: 2.1 time: 0.111418 Sep 09 12:07:17.301058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 106/215] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:17 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:17.369408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:17.370319 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:17.378181 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.378660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.379267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.380417 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.381201 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.381871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.590945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:17.592950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:17.623418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.626735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.630200 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.634408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.639567 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.640513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.716461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:17.742077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75c220b1-0b6f-4f25-93ee-6fef1d2a39ab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.376540 Sep 09 12:07:17.742267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 110/216] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:17 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:17.775020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:17.775632 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:17.787246 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.787938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.788373 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:17.790935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:17.792653 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:17.793267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.012594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:18.023224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6ef4ba0-22c6-4ec5-8918-eb4a9e1eff4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1516 microversion: 2.1 time: 0.437508 Sep 09 12:07:18.026659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 107/217] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:17 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1516 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:18.050012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:18.052248 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:18.060258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.060997 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.061756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.062760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.063511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.064100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.136801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lazy-loading 'flavor' on Instance uuid 7e64b8c4-2489-4e97-89d1-d32f50da6e2c {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:07:18.292877 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4ab9a054-4622-4c18-90c6-1f8964b35367 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c/action" status: 200 len: 32 microversion: 2.1 time: 0.246786 Sep 09 12:07:18.294659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 108/218] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:07:18 2022] POST /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 12:07:18.301853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:18.303398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:18.310820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.311307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.312060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.312917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.313715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.313967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.388396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:18.399342 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6282847-e2e9-4b8d-b5cd-88650fbad541 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1315 microversion: 2.1 time: 0.628790 Sep 09 12:07:18.414577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 111/219] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:17 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:18.414577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:18.414577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:18.420634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.423000 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.423678 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.425011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.426822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.427280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.593164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:18.602619 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:18.604580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:18.607264 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8df67dfe-bbf3-46c2-ac85-44112c1024b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.311094 Sep 09 12:07:18.608083 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 109/220] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:18 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:18.614405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:18.615363 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:18.623009 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.623792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.624431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.625496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.626468 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.627505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.638920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:18.725644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:18.738722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1fa3b30c-9197-427b-8a58-5ebbe35b23ab tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1299 microversion: 2.1 time: 0.129277 Sep 09 12:07:18.740426 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 110/221] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:18 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:18.746975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:18.758832 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-75707f80-88df-4220-a480-15bd5b66346c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.357545 Sep 09 12:07:18.765533 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 112/222] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:18 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:18.772294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:18.773234 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:18.783468 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.784311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.784907 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:18.785767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:18.786958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:18.787939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.060543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:19.073901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b75a0148-bcde-4305-8135-81291b0fb491 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.308633 Sep 09 12:07:19.075252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 111/223] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:18 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:19.423435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:19.424156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:19.431040 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.431607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.432236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.432939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.433374 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.433992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.596127 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:19.598475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:19.606634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3bd7539d-1cac-4d94-881b-43c03f7432d5 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1501 microversion: 2.1 time: 0.186705 Sep 09 12:07:19.607231 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 113/224] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:19 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:19.636067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:19.637597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:19.644599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.645536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.646005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.646767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.647351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.648200 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.769920 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:19.770480 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:19.783718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.783718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.786431 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.787697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.789055 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.790463 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.828164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:19.841602 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:19.847634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:19.848790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-105cbf66-a58b-48e8-9f60-7bb2a433a8fe tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.217016 Sep 09 12:07:19.849711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 112/225] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:19 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:19.855139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:19.856163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:19.864410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.865483 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.866072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.867709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:19.868386 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:19.869032 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:19.978668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:19.989128 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5981a986-9ec1-4ab3-aaf4-eb5e779ed8cf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.225031 Sep 09 12:07:20.015217 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 114/226] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:19 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:20.051384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:20.059963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b87c63e4-0ab4-4203-82df-22681e733364 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.209070 Sep 09 12:07:20.060541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 113/227] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:19 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:20.097309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:20.097853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:20.104773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:20.105265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:20.105699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:20.106836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:20.107274 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:20.107773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:20.270188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:20.279861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e11fcb55-3e7f-408d-8904-d56af85da342 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.186632 Sep 09 12:07:20.280544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 115/228] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:20 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:20.878860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:20.879592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:20.889799 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:20.891819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:20.892290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:20.896306 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:20.898841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:20.899882 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.022519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:21.023128 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:21.030677 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.031525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.032007 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.033066 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.033473 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.033906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.100647 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:21.110753 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:21.112119 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:21.113218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7cafe028-13ce-47d4-a6fd-a36a146655f6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.239165 Sep 09 12:07:21.115254 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 114/229] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:20 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:21.123119 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:21.123904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:21.142131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.142631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.143060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.143762 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.144201 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.144616 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.311377 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:21.321555 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9f4fdb5-7ce9-4e60-92cd-83530ae939d9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.302819 Sep 09 12:07:21.329389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 116/230] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:21 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:21.342368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff663d1b-f507-4522-992c-2419feeeafbb"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:21.349268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:21.365508 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.366768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.367782 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.368515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.368977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.369407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.761991 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:21.770473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b156dd82-5443-46c1-a008-d0fb1c01580a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.653966 Sep 09 12:07:21.771107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 115/231] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:21 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:21.792952 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:21.793562 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:21.800525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.801020 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.801449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:21.802551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:21.803012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:21.803436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.017521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:22.027994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0a6c167e-bc81-4017-8887-e46266df6055 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.238624 Sep 09 12:07:22.029346 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 116/232] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:21 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:22.145741 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:22.146544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:22.152873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:22.153567 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:22.154033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.154776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:22.155228 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:22.155645 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.361607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:22.374046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:22.376404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:22.377722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c78dd4b3-0758-4f91-899f-241fa85b9013 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.236657 Sep 09 12:07:22.379303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 117/233] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:22 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:22.385195 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a24792aa-b1d7-4767-b46e-ac17427f5fbb req-aded440c-41c9-409c-a160-54d9ec0f59b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92db74a9-d7a5-4405-919d-b1ae5f3b8381", "tag": "0a15142d-5557-498e-a9f0-e6da7b25da7f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:22.395071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a24792aa-b1d7-4767-b46e-ac17427f5fbb req-aded440c-41c9-409c-a160-54d9ec0f59b8 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:22.396072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a24792aa-b1d7-4767-b46e-ac17427f5fbb req-aded440c-41c9-409c-a160-54d9ec0f59b8 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:22.396712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a24792aa-b1d7-4767-b46e-ac17427f5fbb req-aded440c-41c9-409c-a160-54d9ec0f59b8 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.408734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a24792aa-b1d7-4767-b46e-ac17427f5fbb req-aded440c-41c9-409c-a160-54d9ec0f59b8 service nova] Creating event network-changed:0a15142d-5557-498e-a9f0-e6da7b25da7f for instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 on hv-cinder-85221 Sep 09 12:07:22.415203 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a24792aa-b1d7-4767-b46e-ac17427f5fbb req-aded440c-41c9-409c-a160-54d9ec0f59b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034169 Sep 09 12:07:22.415903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 118/234] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:22.421120 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:22.421844 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:22.428386 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:22.428885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:22.429325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.430096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:22.430630 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:22.430989 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.567584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:22.576115 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d64d872-912a-4026-94ee-da5c4a1ede62 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.159293 Sep 09 12:07:22.576698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 119/235] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:22 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:22.794538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:22.795062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:22.801527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:22.802014 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:22.802554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.803253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:22.803705 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:22.804197 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:22.940641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:22.948992 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ef353fa8-5d53-4e99-85ae-ea48055c306e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.158566 Sep 09 12:07:22.949662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 120/236] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:22 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:23.056333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:23.057291 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:23.065156 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.065915 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.066456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.067806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.067806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.068177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.204037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:23.212235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-12107036-22d0-42a0-8efb-428c7fde3ebd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.161365 Sep 09 12:07:23.212787 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 121/237] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:23 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:23.338040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c3314d17-8eee-43e9-ad65-71c8d0cb5c78 req-0604e7d9-a790-4924-97a1-a52cea32382d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214a4341-91a9-4b8e-b1db-4e07620cfbf7", "name": "network-vif-plugged", "status": "completed", "tag": "5d843f0d-cb60-459b-ab64-c48fbc48049a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:23.344695 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:23.349249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c3314d17-8eee-43e9-ad65-71c8d0cb5c78 req-0604e7d9-a790-4924-97a1-a52cea32382d service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.349652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c3314d17-8eee-43e9-ad65-71c8d0cb5c78 req-0604e7d9-a790-4924-97a1-a52cea32382d service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.350081 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c3314d17-8eee-43e9-ad65-71c8d0cb5c78 req-0604e7d9-a790-4924-97a1-a52cea32382d service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.364776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c3314d17-8eee-43e9-ad65-71c8d0cb5c78 req-0604e7d9-a790-4924-97a1-a52cea32382d service nova] Creating event network-vif-plugged:5d843f0d-cb60-459b-ab64-c48fbc48049a for instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 on hv-cinder-85221 Sep 09 12:07:23.370475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c3314d17-8eee-43e9-ad65-71c8d0cb5c78 req-0604e7d9-a790-4924-97a1-a52cea32382d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036443 Sep 09 12:07:23.371252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 122/238] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:07:23.408342 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:23.409028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:23.418772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.419289 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.419725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.420425 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.420877 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.421300 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.574655 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:23.583949 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:23.585299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:23.586980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e002eee-433e-4a2a-8d8d-50299132b6ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.183070 Sep 09 12:07:23.587546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 123/239] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:23 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:23.603543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:23.604231 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:23.611311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.611809 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.612253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.613028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.613528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.613963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.771172 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:23.781845 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67310086-b681-4276-b9fa-e0dd6f64d424 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.182433 Sep 09 12:07:23.786161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 124/240] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:23 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:23.973288 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:23.974468 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:23.982809 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.983592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.984223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:23.985160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:23.985883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:23.986590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:24.144728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:24.154801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-634c38c7-9c68-4e3a-b35b-bb79eef52636 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.185218 Sep 09 12:07:24.155389 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 125/241] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:23 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:24.236117 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:24.236784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:24.243636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:24.244077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:24.244604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:24.245837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:24.246298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:24.246781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:24.392229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:24.400076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cbb0ecb0-29c4-451c-8eff-13b25011586a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.167794 Sep 09 12:07:24.400644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 126/242] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:24 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:24.615820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:24.616440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:24.624004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:24.624706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:24.625325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:24.626102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:24.626535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:24.626962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:24.821136 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:24.829245 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:24.830731 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:24.831842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bfd73e30-6142-412e-9d1f-44961fc73fb1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.222170 Sep 09 12:07:24.832416 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 127/243] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:24 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:24.837386 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:24.838054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:24.850585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:24.851131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:24.852193 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:24.852927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:24.853385 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:24.853815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:24.858345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:24.986899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:24.994675 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80c727ad-6e3f-47d0-be93-da60e5bcb3d4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.161280 Sep 09 12:07:24.995536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 128/244] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:24 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:25.177927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:25.178631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:25.184570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:25.185714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:25.186411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:25.186829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:25.187558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:25.187891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:25.336521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:25.344284 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67ba4bea-f3b1-47f5-8c05-c826c5cfa974 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.170111 Sep 09 12:07:25.344872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 129/245] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:25 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:25.422559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:25.423174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:25.429022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:25.429509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:25.429944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:25.430666 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:25.431171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:25.431549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:25.571560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:25.579756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ac4d7a2-7641-4925-b0e1-234eddea1376 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.160918 Sep 09 12:07:25.580509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 130/246] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:25 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:25.858594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:25.859208 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:25.865401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:25.865890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:25.866355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:25.867052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:25.867508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:25.867932 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:26.018131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:26.027368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:26.028823 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:26.029950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e90b8b1-6b22-4b93-a351-e452909ee854 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.175358 Sep 09 12:07:26.030562 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 131/247] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:25 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:26.035068 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:26.035668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:26.041703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:26.042476 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:26.042913 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:26.043619 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:26.044065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:26.044486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:26.180733 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:26.190495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7d4476b9-6913-4269-be1c-2b3f9ba43ae5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.158867 Sep 09 12:07:26.191077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 132/248] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:26 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:26.367918 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:26.368616 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:26.374796 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:26.375276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:26.375719 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:26.376420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:26.376879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:26.377305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:26.520652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:26.529250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f2f3584-1473-4077-928d-0e1e6232239c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.165801 Sep 09 12:07:26.529876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 133/249] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:26 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:26.603574 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:26.604195 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:26.610475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:26.610961 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:26.611400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:26.612296 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:26.612756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:26.613184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:26.756965 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:26.764814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f9d8f76-7dbc-482d-91e5-43c0021e4f46 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.165355 Sep 09 12:07:26.765397 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 134/250] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:26 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:27.056220 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:27.056845 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:27.066299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.066845 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.067242 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.067946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.068399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.068826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.212498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:27.221154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:27.222725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:27.223899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df3eb79e-b0ac-421e-af53-926ab1951960 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.173162 Sep 09 12:07:27.234149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 135/251] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:27 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:27.234149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:27.234149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:27.243725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.243725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.243725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.243725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.244151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.244151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.383003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:27.390818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c811ffc7-ddd0-42cf-a71d-73b5f24aab38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.164974 Sep 09 12:07:27.391404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 136/252] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:27 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:27.552541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:27.553209 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:27.560688 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.561317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.561840 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.562807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.563625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.564135 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.709789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:27.717940 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8da27cca-5a2c-49e1-bd2c-324c2570741d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.169641 Sep 09 12:07:27.718795 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 137/253] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:27 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:27.787866 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:27.788462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:27.794676 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.795167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.795596 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.796491 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:27.796945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:27.797368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:27.952159 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:27.959880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8219d739-ff0e-490e-b325-fe22560cc10c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.175848 Sep 09 12:07:27.960527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 138/254] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:27 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:28.251210 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:28.252715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:28.259957 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:28.260441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:28.260903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:28.261639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:28.262099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:28.262543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:28.414894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:28.423805 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:28.425333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:28.426640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-186ca521-86ae-4b8a-9243-1436b7057430 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.179246 Sep 09 12:07:28.427349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 139/255] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:28 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:28.452786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:28.453510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:28.460492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:28.461192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:28.461635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:28.462373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:28.462992 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:28.463421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:28.685181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:28.696975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aa76c61f-6eec-42f8-81c9-61cd8ca3b1e2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.258220 Sep 09 12:07:28.717555 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 140/256] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:28 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:28.744461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:28.745815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:28.756209 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:28.757253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:28.758282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:28.759439 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:28.760433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:28.769225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:29.020799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6d3942b2-14e8-4cc4-807b-0bba0a1637cb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "POST /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.688864 Sep 09 12:07:29.022794 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 117/257] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:07:21 2022] POST /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec/os-volume_attachments => generated 194 bytes in 7693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:29.046169 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:29.054060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:29.067030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:29.069124 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:29.072490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:29.073482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:29.074511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:29.076166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:29.631206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:29.643381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-33a6dfa9-b2b8-427b-8375-3f9394f15184 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.904572 Sep 09 12:07:29.643381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 141/258] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:28 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:29.679378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:29.685659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:29.698455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:29.699123 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:29.700396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:29.701280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:29.701900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:29.702509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:29.762647 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:29.783732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05769d24-30ce-414d-9827-0a3251d13ad8 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.755429 Sep 09 12:07:29.786397 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 118/259] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:29 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:29.796724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:29.798961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:29.807031 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:29.807886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:29.808484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:29.809383 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:29.810409 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:29.811199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:30.109110 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:30.125022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-794a2c97-69e7-406c-b2bc-998ef1c91534 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.337298 Sep 09 12:07:30.134875 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 119/260] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:29 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:30.192674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:30.203344 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:30.204803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:30.205950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-114de8c0-a03b-4cb9-b8df-0f645b3e36c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.536328 Sep 09 12:07:30.206549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 142/261] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:29 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:30.670359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:30.670359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:30.678454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:30.683275 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:30.686152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:30.687261 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:30.690394 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:30.691940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:30.808204 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:30.808855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:30.816952 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:30.817362 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:30.818916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:30.827094 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:30.828711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:30.829130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:30.923683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:30.934619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-130531ee-31d7-4ca1-bd06-86788bc67aaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.273381 Sep 09 12:07:30.935243 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 120/262] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:30 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:31.028355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:31.036073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dd0bcac9-269c-4ede-a88e-643503286a8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.232271 Sep 09 12:07:31.036666 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 143/263] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:30 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:31.151554 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:31.152324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:31.159131 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:31.159650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:31.160080 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:31.160772 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:31.161249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:31.161670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:31.234922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:31.235542 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:31.243309 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:31.243812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:31.244252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:31.244945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:31.245662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:31.246091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:31.347094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:31.358305 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6d23713-6837-4ddb-8dc7-376217699c5d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.211214 Sep 09 12:07:31.360367 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 121/264] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:31 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:31.454397 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:31.457500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:31.472319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:31.476573 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:31.478211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a35fab55-ed49-43ba-bf13-2d61b0ccae45 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.247142 Sep 09 12:07:31.478965 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 144/265] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:31 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:31.958808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:31.959424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:31.979370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eaa7dc64-03a7-45cb-b615-8ee93135747d req-3693b299-450d-4ce8-ac91-eefcf4002566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00de6121-bfa1-4888-af77-69a8f8800324", "name": "network-vif-plugged", "status": "completed", "tag": "fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:32.003548 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.004091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.005527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.009278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.010095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.010773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.013327 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eaa7dc64-03a7-45cb-b615-8ee93135747d req-3693b299-450d-4ce8-ac91-eefcf4002566 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.014079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eaa7dc64-03a7-45cb-b615-8ee93135747d req-3693b299-450d-4ce8-ac91-eefcf4002566 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.014879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eaa7dc64-03a7-45cb-b615-8ee93135747d req-3693b299-450d-4ce8-ac91-eefcf4002566 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.048736 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eaa7dc64-03a7-45cb-b615-8ee93135747d req-3693b299-450d-4ce8-ac91-eefcf4002566 service nova] Creating event network-vif-plugged:fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632 for instance 00de6121-bfa1-4888-af77-69a8f8800324 on hv-cinder-85221 Sep 09 12:07:32.063419 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eaa7dc64-03a7-45cb-b615-8ee93135747d req-3693b299-450d-4ce8-ac91-eefcf4002566 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100822 Sep 09 12:07:32.064019 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 145/266] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:32.083429 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:32.084116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:32.096776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.097505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.098153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.099045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.099717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.100423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.263534 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:32.271636 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2b64fc52-ed9e-47d8-800a-150ab9f0b934 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.318293 Sep 09 12:07:32.273808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 122/267] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:31 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:32.304042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:32.314789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fbff72b3-9901-4138-8acf-d826cc0daa28 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.234941 Sep 09 12:07:32.316042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 146/268] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:32 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:32.386008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:32.386634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:32.392421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.393079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.393332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.394240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.394723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.395233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.504043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:32.504656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:32.513551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.515084 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.515715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.516455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:32.520229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:32.520899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:32.551490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:32.566746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-818bc78a-e3ef-4469-9ee4-913a1dca066b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.184140 Sep 09 12:07:32.567754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 123/269] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:32 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:32.742148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:32.751946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:32.753736 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:32.755140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69652436-8114-4b9e-8ec6-275c533c1bab tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1406 microversion: 2.20 time: 0.255606 Sep 09 12:07:32.771089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 147/270] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:32 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:07:33.296504 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:33.297279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:33.306716 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.307439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.308017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.309094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.319917 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.320536 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.339901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:33.340533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:33.348092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.349115 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.350102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.352117 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.353244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.354047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.563652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:33.571740 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-870d327a-a029-4e1d-aa5f-aea76af4da4f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.279326 Sep 09 12:07:33.572875 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 124/271] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:33 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:33.592003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:33.592838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:33.597584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:33.599606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.600542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.601700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.602575 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.603475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.604272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.606510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dba7e80d-58b8-4166-bc3b-49ef31933c87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.271350 Sep 09 12:07:33.607250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 148/272] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:33 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:33.780881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:33.781566 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:33.791142 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.791632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.792072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.793140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:33.793406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:33.793983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:33.806755 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:33.815849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd7a9131-0fee-4d54-8397-8e83d8074fa4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.227545 Sep 09 12:07:33.818893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 125/273] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:33 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:33.964556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:33.975702 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:33.978726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:33.980065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e4b999dd-849f-4473-866f-ed09f32302a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1599 microversion: 2.20 time: 0.203583 Sep 09 12:07:33.980728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 149/274] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:07:33 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1599 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:07:34.006332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:34.006827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:34.014721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.015392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.016053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.016922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.017671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.018415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.116159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a938cacc-a91f-45c0-ad36-614c09f54279 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113670 Sep 09 12:07:34.117383 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 126/275] 10.222.0.62 () {60 vars in 1316 bytes} [Fri Sep 9 12:07:34 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:07:34.595505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:34.596355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:34.603221 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.603728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.604151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.604864 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.605969 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.606836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.631000 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:34.633140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:34.639347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.640200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.640697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.641608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.642587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.643198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.779583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:34.788116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7758f63-25a1-46b0-bf2e-495bbffa043a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.196934 Sep 09 12:07:34.789287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 150/276] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:34 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:34.847583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:34.848421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:34.859554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.860635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.861140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.861916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:34.863545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:34.864040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:34.975830 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:34.984403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78df0bcc-2002-440a-b0cd-cc2ccfb131e9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.357620 Sep 09 12:07:34.989075 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 127/277] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:34 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:35.064204 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:35.076197 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00d91ea3-b678-4032-9c05-e8b970ab0c4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.233273 Sep 09 12:07:35.077545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 151/278] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:34 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:35.798145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a7c6b252-f1af-42e1-a88b-872b895f6105 req-4a22e165-13b6-49a3-b4f6-63eecc6beb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214a4341-91a9-4b8e-b1db-4e07620cfbf7", "tag": "5d843f0d-cb60-459b-ab64-c48fbc48049a"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:35.809931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7c6b252-f1af-42e1-a88b-872b895f6105 req-4a22e165-13b6-49a3-b4f6-63eecc6beb5b service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:35.810728 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7c6b252-f1af-42e1-a88b-872b895f6105 req-4a22e165-13b6-49a3-b4f6-63eecc6beb5b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:35.811164 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7c6b252-f1af-42e1-a88b-872b895f6105 req-4a22e165-13b6-49a3-b4f6-63eecc6beb5b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:35.820250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:35.821664 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:35.826943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a7c6b252-f1af-42e1-a88b-872b895f6105 req-4a22e165-13b6-49a3-b4f6-63eecc6beb5b service nova] Creating event network-changed:5d843f0d-cb60-459b-ab64-c48fbc48049a for instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 on hv-cinder-85221 Sep 09 12:07:35.829799 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:35.830662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:35.831574 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:35.832601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:35.833270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:35.833964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:35.835078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a7c6b252-f1af-42e1-a88b-872b895f6105 req-4a22e165-13b6-49a3-b4f6-63eecc6beb5b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Sep 09 12:07:35.839282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 128/279] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:35.986134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:35.996105 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e947ce72-10db-4973-a0c1-ab88efc1801d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.183073 Sep 09 12:07:35.996722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 152/280] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:35 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:36.019869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:36.020793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:36.028199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:36.028910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:36.029513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:36.030246 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:36.030702 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:36.031130 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:36.101577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:36.102245 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:36.109387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:36.110298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:36.111007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:36.111931 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:36.112597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:36.113720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:36.217418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:36.230468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb935570-f3e9-4822-bf4d-2987adaed71b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.213629 Sep 09 12:07:36.231464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 129/281] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:36 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:36.350048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:36.360884 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a9298350-edf6-47f9-96c7-e84c074f998a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.263758 Sep 09 12:07:36.374161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 153/282] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:36 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:37.021202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:37.022677 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:37.041160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:37.041691 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:37.042199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:37.042922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:37.043401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:37.044079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:37.069953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:37.222611 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:37.235496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38adcd36-db93-46ea-b9ca-da4e240281b7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.218293 Sep 09 12:07:37.236381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 130/283] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:37 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:37.257025 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:37.259155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:37.266147 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:37.266775 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:37.267276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:37.268233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:37.268902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:37.269539 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:37.385489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:37.386152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:37.393295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:37.394340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:37.394779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:37.395480 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:37.395930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:37.396347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:37.436305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:37.446692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-026fcf90-4f6d-4476-a12b-88f9fe4932cb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.196039 Sep 09 12:07:37.448709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 154/284] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:37 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:37.601989 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:37.614357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7d66eb60-eb09-4787-bc7d-733b98bc9a5e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.232877 Sep 09 12:07:37.614897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 131/285] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:37 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:38.261082 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:38.261899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:38.267738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:38.268224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:38.268857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:38.269564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:38.270020 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:38.270476 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:38.438776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:38.451043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83225117-94c1-480c-8148-ce8cd032f2d3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.194142 Sep 09 12:07:38.451855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 155/286] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:38 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:38.476497 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:38.478671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:38.493121 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:38.493799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:38.494353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:38.496628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:38.497507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:38.498306 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:38.637732 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:38.638600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:38.645685 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:38.646598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:38.647210 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:38.648167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:38.648610 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:38.649034 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:38.863776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:38.876009 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4c8c8b44-9680-4dd7-a533-e7b1c329e8fc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.239964 Sep 09 12:07:38.889223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 156/287] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:38 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:38.958201 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:38.967737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eb7ca935-7e80-4574-8b1a-fd3373cc2254 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1363 microversion: 2.1 time: 0.497271 Sep 09 12:07:38.968621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 132/288] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:38 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:39.474676 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:39.475292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:39.486528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:39.487775 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:39.488338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:39.489391 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:39.489922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:39.490583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:39.676264 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:39.684446 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfced3df-136e-4305-93f0-a38ac18c9bcc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.213467 Sep 09 12:07:39.685466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 157/289] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:39 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:39.909985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:39.912259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:39.919828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=76 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:39.922067 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:39.922811 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:39.924645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:39.925841 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:39.926447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:39.927146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:39.991902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:39.992528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:39.998814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:39.999473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:40.000215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:40.001401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:40.002299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:40.003132 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:40.143239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:40.159580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2cd13cbc-17bc-4c09-b13a-84e78199d4eb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.254833 Sep 09 12:07:40.167962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 133/290] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:39 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:40.260694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:40.274155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-685f403e-fd14-4521-a2c5-143a0591dbb4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1548 microversion: 2.1 time: 0.285333 Sep 09 12:07:40.308229 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:40.308959 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:40.315371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 158/291] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:39 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1548 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:40.317857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:40.318531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:40.319178 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:40.321232 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:40.321942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:40.322914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:40.437229 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0835a22b-a969-4b48-b4b3-12bc0b77609c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138521 Sep 09 12:07:40.437901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 134/292] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:07:40 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:40.708846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:40.711604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:40.720246 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:40.723951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:40.724655 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:40.726206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:40.728055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:40.728711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:40.746013 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b7356b35-e9db-4c37-abea-06fc3725c0d6 req-7c83248a-f831-4d4d-a033-521e4dd7c1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92db74a9-d7a5-4405-919d-b1ae5f3b8381", "name": "network-vif-plugged", "status": "completed", "tag": "0a15142d-5557-498e-a9f0-e6da7b25da7f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:40.774872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7356b35-e9db-4c37-abea-06fc3725c0d6 req-7c83248a-f831-4d4d-a033-521e4dd7c1f8 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:40.782627 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7356b35-e9db-4c37-abea-06fc3725c0d6 req-7c83248a-f831-4d4d-a033-521e4dd7c1f8 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:40.784241 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b7356b35-e9db-4c37-abea-06fc3725c0d6 req-7c83248a-f831-4d4d-a033-521e4dd7c1f8 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:40.824642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b7356b35-e9db-4c37-abea-06fc3725c0d6 req-7c83248a-f831-4d4d-a033-521e4dd7c1f8 service nova] Creating event network-vif-plugged:0a15142d-5557-498e-a9f0-e6da7b25da7f for instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 on hv-cinder-85221 Sep 09 12:07:40.831166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b7356b35-e9db-4c37-abea-06fc3725c0d6 req-7c83248a-f831-4d4d-a033-521e4dd7c1f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090599 Sep 09 12:07:40.832420 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 135/293] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:41.186197 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:41.186928 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:41.211518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:41.215812 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:41.216715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:41.218045 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:41.223426 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:41.225366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:41.340348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:41.352654 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ed7a0a3-09a7-4f96-a0cf-d1a5eff53566 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.647724 Sep 09 12:07:41.353784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 159/294] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:40 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:41.613515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:41.633719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1165b01-5d3a-40f7-a693-1cc4f1b075a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.452103 Sep 09 12:07:41.635226 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 136/295] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:41 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:42.136085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:42.138922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:42.147353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.148743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.149655 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.150385 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.150838 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.151256 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.185177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:07:42.256127 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:42.305810 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a382eac0-59f3-4a97-8b3b-2cab8969558e tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 204 len: 0 microversion: 2.1 time: 0.174839 Sep 09 12:07:42.309294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 160/296] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:07:42 2022] DELETE /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:07:42.316447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:42.317051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:42.324645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.325315 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.325939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.326654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.328054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.328485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.377943 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:42.379038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:42.389936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.390994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.391784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.392785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.393464 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.394104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.609364 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:42.623366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-48ba3cff-2133-4b0a-bece-f186e926f6ff tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.312207 Sep 09 12:07:42.624901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 137/297] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:42 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:42.681912 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:42.683065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:42.692439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.693318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.694034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.695682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.696418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.697056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.710909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:42.729709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ddeb910a-d215-4ecb-8e0d-406c96cf3b27 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.354043 Sep 09 12:07:42.742374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 161/298] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:42 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:42.758778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-93aae51a-fd93-4fb9-b48f-feb42d7de340 req-ed62b272-6512-4e8f-9089-99367c0a9ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00de6121-bfa1-4888-af77-69a8f8800324", "tag": "fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:42.768367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-93aae51a-fd93-4fb9-b48f-feb42d7de340 req-ed62b272-6512-4e8f-9089-99367c0a9ed9 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:42.768854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-93aae51a-fd93-4fb9-b48f-feb42d7de340 req-ed62b272-6512-4e8f-9089-99367c0a9ed9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:42.769286 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-93aae51a-fd93-4fb9-b48f-feb42d7de340 req-ed62b272-6512-4e8f-9089-99367c0a9ed9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:42.786859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-93aae51a-fd93-4fb9-b48f-feb42d7de340 req-ed62b272-6512-4e8f-9089-99367c0a9ed9 service nova] Creating event network-changed:fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632 for instance 00de6121-bfa1-4888-af77-69a8f8800324 on hv-cinder-85221 Sep 09 12:07:42.792337 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-93aae51a-fd93-4fb9-b48f-feb42d7de340 req-ed62b272-6512-4e8f-9089-99367c0a9ed9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037723 Sep 09 12:07:42.797284 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 162/299] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:07:42.967292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:42.977163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccf325eb-098a-49dd-abba-262df403b159 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.301773 Sep 09 12:07:42.977968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 138/300] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:42 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:43.646869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:43.647582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:43.654143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:43.654657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:43.655095 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:43.655799 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:43.656265 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:43.656692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:43.749355 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:43.750078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:43.758695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:43.759379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:43.760033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:43.760891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:43.761500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:43.762079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:43.832711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:43.844328 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-265797e7-2104-4628-a6ee-d219bb025c5c tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.201599 Sep 09 12:07:43.845585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 163/301] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:43 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:43.910883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:43.921113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b848141d-1e95-40c6-a834-0a2a2cb2ac5b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.175664 Sep 09 12:07:43.921698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 139/302] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:43 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:44.001279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:44.002073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:44.008704 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:44.009297 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:44.009891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:44.010759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:44.011323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:44.011984 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:44.156260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:44.165249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8aab00a7-cd3b-4dc6-b9e9-a92445a24e3a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.167526 Sep 09 12:07:44.177001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 164/303] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:43 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:44.868551 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:44.869166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:44.876001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:44.876489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:44.876926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:44.877619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:44.878074 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:44.878524 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:44.944000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:44.945155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:44.952378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:44.952974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:44.953533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:44.954431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:44.955047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:44.955663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:45.014925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:45.023948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3a1aa591-ab1e-4343-a435-fc4d4f46c504 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.159982 Sep 09 12:07:45.024525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 140/304] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:44 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:45.094345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:45.102536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de17d2b9-8dc1-402b-b47e-a10b1314a8c0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.162753 Sep 09 12:07:45.103103 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 165/305] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:44 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:45.196959 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:45.197570 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:45.203652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:45.204278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:45.204845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:45.205577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:45.206033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:45.206486 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:45.336257 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:45.343948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-381d14b4-6def-4909-9c23-a7249378cc71 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1367 microversion: 2.1 time: 0.150936 Sep 09 12:07:45.344707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 141/306] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:45 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:45.699298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-625008541", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "networks": [{"uuid": "308ada5c-f0ed-4ca7-89ad-19e4711c1427"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:45.900661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] validate_networks() for [('308ada5c-f0ed-4ca7-89ad-19e4711c1427', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:07:46.048098 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:46.048801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:46.055681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.056166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.056600 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.057294 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.057748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.058198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.200365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:46.209268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9470c5a2-b577-4531-88f1-61b2aa9d3da9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.165468 Sep 09 12:07:46.209882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 142/307] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:46 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:46.214707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:46.215535 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:46.222507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.223988 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.224673 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.226398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.227265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.228239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.315881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:07:46.316545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:07:46.317405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:07:46.317977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:07:46.318373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:07:46.327668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.328418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.329126 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.329797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.330281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.330708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.347501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Getting quotas for project f85c5e478d5c4efca84cb570537ea15d. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:07:46.351293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:46.353287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Getting quotas for user eef1afc3ece940248494501dd27e3920 and project f85c5e478d5c4efca84cb570537ea15d. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:07:46.366234 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:07:46.368542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:46.369153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:07:46.376621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fed2eecd-7b91-4329-a97c-82fdd855d5a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.165727 Sep 09 12:07:46.377613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 143/308] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:46 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:46.382365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:46.383053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:46.389114 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.389674 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.390208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.391003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.391661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.392313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.417085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-993aaec5-1909-4a0b-be6e-71d4203dbeae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721533 Sep 09 12:07:46.423817 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 166/309] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:07:46.429933 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1a2401d-69ab-45f5-823a-4473eb83c507 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:46.430587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1a2401d-69ab-45f5-823a-4473eb83c507 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:46.486979 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1a2401d-69ab-45f5-823a-4473eb83c507 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:46.496495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1a2401d-69ab-45f5-823a-4473eb83c507 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1213 microversion: 2.1 time: 0.070911 Sep 09 12:07:46.497341 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 167/310] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:46 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:46.533328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:46.543131 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ab1790c-8fd6-4f14-bb7c-9bd7ff79dbd7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1557 microversion: 2.1 time: 0.164351 Sep 09 12:07:46.543767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 144/311] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:46 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:46.566556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:46.566963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:46.573361 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.573851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.574358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.575951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:46.576450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:46.576976 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:46.668421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2d46f679-2391-4fcb-86ce-be7712f4df09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105792 Sep 09 12:07:46.669118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 168/312] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:07:46 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:47.233732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:47.234371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:47.240845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:47.241458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:47.241908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:47.242626 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:47.243084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:47.243586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:47.372491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:47.380757 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41ec4caf-a2b1-4d53-ba76-7fbe93260a74 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.150853 Sep 09 12:07:47.381334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 145/313] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:47 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:47.401108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:47.401728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:47.407674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:47.408157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:47.408587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:47.409270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:47.409723 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:47.410161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:47.519422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:47.520123 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:47.526106 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:47.526622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:47.527056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:47.527747 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:47.528204 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:47.528624 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:47.592522 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:47.600732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d082b2ee-bcfa-46d6-8a37-003b3787cec6 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1217 microversion: 2.1 time: 0.085154 Sep 09 12:07:47.601469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 146/314] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:47 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:47.608673 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:47.625820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56b04536-e4f5-4f6f-9258-7fd33d168638 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.228454 Sep 09 12:07:47.626449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 169/315] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:47 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:47.706633 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-890bf489-8f40-40f7-b04a-b9b5cc311a81 req-a7fc183e-0ec4-4706-9319-64ec04cb744d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92db74a9-d7a5-4405-919d-b1ae5f3b8381", "tag": "0a15142d-5557-498e-a9f0-e6da7b25da7f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:47.716418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-890bf489-8f40-40f7-b04a-b9b5cc311a81 req-a7fc183e-0ec4-4706-9319-64ec04cb744d service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:47.716979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-890bf489-8f40-40f7-b04a-b9b5cc311a81 req-a7fc183e-0ec4-4706-9319-64ec04cb744d service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:47.717478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-890bf489-8f40-40f7-b04a-b9b5cc311a81 req-a7fc183e-0ec4-4706-9319-64ec04cb744d service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:47.729273 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-890bf489-8f40-40f7-b04a-b9b5cc311a81 req-a7fc183e-0ec4-4706-9319-64ec04cb744d service nova] Creating event network-changed:0a15142d-5557-498e-a9f0-e6da7b25da7f for instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 on hv-cinder-85221 Sep 09 12:07:47.734496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-890bf489-8f40-40f7-b04a-b9b5cc311a81 req-a7fc183e-0ec4-4706-9319-64ec04cb744d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031472 Sep 09 12:07:47.735123 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 147/316] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:48.404843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.405481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:48.411576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:48.412056 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:48.412481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:48.413233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:48.413683 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:48.414102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:48.549900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:48.559257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18507b0e-4b40-4577-b022-085a7d32714b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.158141 Sep 09 12:07:48.559855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 170/317] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:48.632464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.633346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:48.640052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:48.640837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:48.644723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:48.645728 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:48.646662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:48.648458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:48.649875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:48.650514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:48.661971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:48.662435 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:48.662970 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:48.663852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:48.664307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:48.665056 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:48.665312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:48.717984 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:48.726029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b85ef69-c5ef-484e-bf62-16bab59f41e9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1217 microversion: 2.1 time: 0.099178 Sep 09 12:07:48.726672 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 148/318] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:48.801186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:48.809541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3f74325-6452-4622-a39b-c087807e38e7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.164655 Sep 09 12:07:48.810108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 171/319] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:48 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:49.583418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:49.584036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:49.590593 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:49.591161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:49.591515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:49.592205 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:49.592663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:49.593089 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:49.722452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:49.731095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc44899d-a71b-4b82-9a2c-399d7f6c3006 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.151829 Sep 09 12:07:49.731643 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 149/320] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:49 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:49.748557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:49.749154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:49.755273 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:49.755755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:49.756184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:49.756867 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:49.757319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:49.757741 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:49.832955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:49.833655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:49.840318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:49.840842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:49.841282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:49.841994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:49.842489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:49.842920 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:49.986180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:49.994014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53ef066c-76b4-41ef-aaf8-c43baed96e9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.164942 Sep 09 12:07:49.994623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 150/321] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:49 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:50.038578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:50.047470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ee8cac7-dee5-451e-9bc4-30f183648eb1 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1217 microversion: 2.1 time: 0.302968 Sep 09 12:07:50.048230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 172/322] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:49 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:50.195333 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-27b1447d-f74e-4da1-acd3-a3198f4a2bd4 req-8eae6cc2-d629-4e45-bc58-70ed05b17937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd9048c-290a-4f95-b832-04d69866e0ec", "name": "network-vif-unplugged", "status": "completed", "tag": "cc41c44e-1bf1-41da-8d41-30c72060a07f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:50.205295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-27b1447d-f74e-4da1-acd3-a3198f4a2bd4 req-8eae6cc2-d629-4e45-bc58-70ed05b17937 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:50.205775 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-27b1447d-f74e-4da1-acd3-a3198f4a2bd4 req-8eae6cc2-d629-4e45-bc58-70ed05b17937 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:50.206239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-27b1447d-f74e-4da1-acd3-a3198f4a2bd4 req-8eae6cc2-d629-4e45-bc58-70ed05b17937 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:50.218075 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-27b1447d-f74e-4da1-acd3-a3198f4a2bd4 req-8eae6cc2-d629-4e45-bc58-70ed05b17937 service nova] Creating event network-vif-unplugged:cc41c44e-1bf1-41da-8d41-30c72060a07f for instance fdd9048c-290a-4f95-b832-04d69866e0ec on hv-cinder-85221 Sep 09 12:07:50.229714 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-27b1447d-f74e-4da1-acd3-a3198f4a2bd4 req-8eae6cc2-d629-4e45-bc58-70ed05b17937 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037266 Sep 09 12:07:50.232051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 151/323] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:50.753462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:50.754932 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:50.764504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:50.765321 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:50.765977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:50.767107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:50.767842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:50.768474 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:51.021695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:51.024281 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:51.035440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:51.036698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:51.037687 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:51.038840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:51.039608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:51.040267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:51.057506 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:51.074080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b222267-0d4b-4c1f-a644-6a141e563ff3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1553 microversion: 2.1 time: 0.324423 Sep 09 12:07:51.074706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 173/324] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:50 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1553 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:51.082097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:51.082746 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:51.092066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:51.092815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:51.093406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:51.094905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:51.095515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:51.096095 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:51.186070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:51.196778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4026daac-15a8-4157-afe4-08e308721b71 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1265 microversion: 2.1 time: 0.120872 Sep 09 12:07:51.197614 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 174/325] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:51 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:51.528529 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:51.537058 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-291e39e3-435f-4207-a0b9-f0c79f7e7a83 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.522044 Sep 09 12:07:51.538071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 152/326] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:51 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:51.702870 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6a8d0dcf-af0b-4984-ab3e-22871d44b775 req-947e79fa-6a46-45e1-b9f8-531294d3d55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd9048c-290a-4f95-b832-04d69866e0ec", "name": "network-vif-deleted", "tag": "cc41c44e-1bf1-41da-8d41-30c72060a07f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:51.715064 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6a8d0dcf-af0b-4984-ab3e-22871d44b775 req-947e79fa-6a46-45e1-b9f8-531294d3d55f service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:51.715637 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6a8d0dcf-af0b-4984-ab3e-22871d44b775 req-947e79fa-6a46-45e1-b9f8-531294d3d55f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:51.716205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6a8d0dcf-af0b-4984-ab3e-22871d44b775 req-947e79fa-6a46-45e1-b9f8-531294d3d55f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:51.730109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6a8d0dcf-af0b-4984-ab3e-22871d44b775 req-947e79fa-6a46-45e1-b9f8-531294d3d55f service nova] Creating event network-vif-deleted:cc41c44e-1bf1-41da-8d41-30c72060a07f for instance fdd9048c-290a-4f95-b832-04d69866e0ec on hv-cinder-85221 Sep 09 12:07:51.736276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6a8d0dcf-af0b-4984-ab3e-22871d44b775 req-947e79fa-6a46-45e1-b9f8-531294d3d55f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036617 Sep 09 12:07:51.737043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 175/327] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:07:52.096763 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:52.097363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:52.103466 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:52.104053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:52.104488 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:52.105167 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:52.105614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:52.106032 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:52.168031 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:52.176423 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec556eea-e379-4cdb-815c-0c4d30372b6d tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1511 microversion: 2.1 time: 0.083495 Sep 09 12:07:52.176977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 153/328] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:52 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:52.220541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:52.221327 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:52.228226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:52.228715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:52.229142 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:52.229827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:52.230319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:52.230735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:52.299380 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:52.307765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56fbb192-43ac-4b1a-8778-bc08511cc468 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1265 microversion: 2.1 time: 0.091416 Sep 09 12:07:52.308325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 176/329] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:52 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:52.560785 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:52.561377 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:52.567372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:52.567857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:52.568294 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:52.568975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:52.569430 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:52.569853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:52.699225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:52.707198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e5929fc4-be47-452f-9bac-e5bf07e88841 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.150362 Sep 09 12:07:52.707762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 154/330] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:52 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:53.200621 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:53.201251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:53.207458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:53.207940 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:53.208369 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:53.209048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:53.209496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:53.209982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:53.271941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:53.280885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56dcd51f-bc30-4a5f-a434-c837c5a8b6bb tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1511 microversion: 2.1 time: 0.084133 Sep 09 12:07:53.281454 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 177/331] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:53 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:53.330409 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:53.331044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:53.337674 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:53.338185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:53.338617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:53.339293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:53.339742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:53.340158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:53.401971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:53.410419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e6cdb37-ca5a-40a4-a242-2fc685719427 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1265 microversion: 2.1 time: 0.083851 Sep 09 12:07:53.410969 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 155/332] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:53 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:53.730839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:53.731451 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:53.737423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:53.737908 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:53.738392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:53.739079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:53.739540 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:53.739962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:53.868287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:53.876566 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9149ec7c-1551-43e8-b0f1-00a3ce327dde tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.149594 Sep 09 12:07:53.877186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 178/333] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:53 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:54.302533 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:54.303138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:54.309380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:54.309932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:54.310305 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:54.314424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:54.314424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:54.314424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:54.374206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:54.382768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f19ee13-07ee-4757-b899-9bd510cf8f83 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1511 microversion: 2.1 time: 0.084127 Sep 09 12:07:54.383324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 156/334] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:54 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:54.432726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:54.433370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:54.439338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:54.439818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:54.440257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:54.440944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:54.441396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:54.441819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:54.502217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:54.510276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdd2712b-d2b2-451b-a847-10f6d184376f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1265 microversion: 2.1 time: 0.081436 Sep 09 12:07:54.510839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 179/335] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:54 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:54.899680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:54.900287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:54.906258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:54.906744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:54.907185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:54.907866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:54.908320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:54.908747 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:55.034151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:55.041687 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-def01578-50df-46de-aaaa-078452d3c068 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.146005 Sep 09 12:07:55.042266 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 157/336] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:54 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:55.406338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:55.406953 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:55.413528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:55.414012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:55.414484 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:55.415171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:55.415634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:55.416057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:55.431326 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:55.481450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:55.489664 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bbab0ee5-add1-464b-aef7-9ddbaf1871d9 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1511 microversion: 2.1 time: 0.087240 Sep 09 12:07:55.490281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 180/337] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:55 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:55.532921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:55.533567 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:55.541381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:55.541876 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:55.542362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:55.543060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:55.543518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:55.543941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:55.607343 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:55.615092 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f2f4c1c5-badb-4626-a0da-a78a84882489 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1265 microversion: 2.1 time: 0.086146 Sep 09 12:07:55.615655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 158/338] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:55 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:56.064792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:56.065315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:56.071865 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:56.072328 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:56.072763 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:56.073448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:56.073907 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:56.074366 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:56.207037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:56.215512 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-090dbe9a-4407-404e-88f0-cbfcf94f43d7 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.154597 Sep 09 12:07:56.216236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 181/339] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:56 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:56.513014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:56.513697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:56.519918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:56.520402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:56.520839 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:56.521523 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:56.521974 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:56.522449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:56.585252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:56.593353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4d33684-f950-48e2-ab1f-4700558bcf58 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1346 microversion: 2.1 time: 0.084339 Sep 09 12:07:56.594297 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 159/340] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:56 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:56.639337 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:56.640054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:56.641803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:56.642509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:07:56.649545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:56.650160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:56.650690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:56.651395 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:56.651855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:56.652287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:56.744032 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:56.752076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-29117a28-cddc-40cc-a976-e2e2a7a7b39c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1271 microversion: 2.1 time: 0.116713 Sep 09 12:07:56.752646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 182/341] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:56 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:57.244283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:57.245539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:57.253563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.254375 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.255300 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.256328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.257179 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.257781 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.407337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:57.415126 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-695afff8-ff88-4914-b438-67bc7b98bc6a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.178403 Sep 09 12:07:57.415707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 160/342] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:57 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:57.616511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:57.617403 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:57.624139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.624707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.625253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.626090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.626713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.627244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.664849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.665599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.665907 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.666652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lazy-loading 'fault' on Instance uuid fdd9048c-290a-4f95-b832-04d69866e0ec {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:07:57.721576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '326c59915e3d4b7289472d1400730a07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d3583d753d4efab0bcd6769574420b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:57.730533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe1f6c36-e754-49b1-835c-d321036ad7a3 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 200 len: 1351 microversion: 2.1 time: 0.118202 Sep 09 12:07:57.731417 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 183/343] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:57 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:57.775361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:57.776081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:57.783354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.784049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.784575 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.785240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.785934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.786141 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.808124 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-82d1257e-d668-4623-8f07-fd253b78dcc7 req-27db0e2b-4ca9-43ae-b7e4-d112b150253c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fde5d77-c665-4957-8cf5-7bb6bd4b62ca", "tag": "abd2b4c0-a0ae-48e9-bd59-a74703c02c14"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:07:57.819080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82d1257e-d668-4623-8f07-fd253b78dcc7 req-27db0e2b-4ca9-43ae-b7e4-d112b150253c service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:57.819842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82d1257e-d668-4623-8f07-fd253b78dcc7 req-27db0e2b-4ca9-43ae-b7e4-d112b150253c service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:57.820438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-82d1257e-d668-4623-8f07-fd253b78dcc7 req-27db0e2b-4ca9-43ae-b7e4-d112b150253c service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:57.841010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-82d1257e-d668-4623-8f07-fd253b78dcc7 req-27db0e2b-4ca9-43ae-b7e4-d112b150253c service nova] Creating event network-changed:abd2b4c0-a0ae-48e9-bd59-a74703c02c14 for instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca on hv-cinder-85221 Sep 09 12:07:57.848577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-82d1257e-d668-4623-8f07-fd253b78dcc7 req-27db0e2b-4ca9-43ae-b7e4-d112b150253c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043941 Sep 09 12:07:57.849340 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 184/344] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:07:57.952506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:57.962579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30a21b48-497a-43c2-96fb-8f73e6a64082 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.191517 Sep 09 12:07:57.963160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 161/345] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:57 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:07:58.438139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:58.438829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:58.445054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.445536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.445969 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:58.446691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.447143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.447563 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:58.583946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:58.592159 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92fdfe42-3e4c-4390-9930-a560538a1149 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.158286 Sep 09 12:07:58.592785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 185/346] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:58 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:58.753848 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:58.754490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:58.760496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.760977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.761419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:58.762247 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.762630 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.763014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:58.776816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] HTTP exception thrown: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Request method failure captured: Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec HTTP/1.1 Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyw4OH62H3tH0erwCEgD6DdmqbAFAfEreieDdQZ6nYj6kv1oNDNcpoRksFW7-uqEcfVP-dpyttZFy58Rje1XMU8i3MtDevWiFgJhgNzbRLxdZMYDGFz77qoilzpYGOMeZz28AbnFM3aqRwS5mSJBvqhMNdVgpdLw5L_g9lBogLHa10U Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:07:58.788857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19d3583d753d4efab0bcd6769574420b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19d3583d753d4efab0bcd6769574420b"}]}] Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-41102430 Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 326c59915e3d4b7289472d1400730a07 Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.790476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'fdd9048c-290a-4f95-b832-04d69866e0ec'} Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:07:58.791379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.792635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.793645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Returning 404 to user: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:07:58.793645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-caf9e5e4-6248-4d6b-bade-7f51004fcbab tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 404 len: 111 microversion: 2.1 time: 0.040263 Sep 09 12:07:58.793645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 162/347] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:58 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:07:58.904338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:58.906529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:58.912504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.912985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.913421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:58.914106 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.914623 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.915051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:58.927600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] HTTP exception thrown: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Request method failure captured: Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec/os-volume_attachments HTTP/1.1 Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyw4OH62H3tH0erwCEgD6DdmqbAFAfEreieDdQZ6nYj6kv1oNDNcpoRksFW7-uqEcfVP-dpyttZFy58Rje1XMU8i3MtDevWiFgJhgNzbRLxdZMYDGFz77qoilzpYGOMeZz28AbnFM3aqRwS5mSJBvqhMNdVgpdLw5L_g9lBogLHa10U Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:07:58.931752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19d3583d753d4efab0bcd6769574420b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19d3583d753d4efab0bcd6769574420b"}]}] Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-DeleteServersTestJSON-41102430 Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 326c59915e3d4b7289472d1400730a07 Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.933166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'server_id': 'fdd9048c-290a-4f95-b832-04d69866e0ec'} Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:07:58.934090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:07:58.935582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:07:58.937001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Returning 404 to user: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:07:58.937001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25f9e06f-d735-4ab7-9081-210db931a689 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032841 Sep 09 12:07:58.937001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 186/348] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:07:58 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:07:58.985862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:58.986503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:58.992853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.993326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.993746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:58.994458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:58.994905 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:58.995574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:59.130744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:59.138678 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e8801970-7c1b-4546-b9f6-66ec48ff4096 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.156388 Sep 09 12:07:59.139293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 163/349] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:58 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:07:59.617395 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:07:59.618100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:07:59.624299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:59.624781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:59.625220 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:59.625910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:07:59.626399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:07:59.626819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:07:59.770884 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:07:59.781305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4db8680a-2cfa-42d8-b979-412c4b1b8749 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.168132 Sep 09 12:07:59.786161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 187/350] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:07:59 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:00.150098 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:00.150631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:00.157090 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.157577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.158020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.158742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.159206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.159633 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.160794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:00.161411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:00.167415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.167898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.168331 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.169021 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.169503 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.169923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.173079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] HTTP exception thrown: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Request method failure captured: Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec HTTP/1.1 Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyw4OH62H3tH0erwCEgD6DdmqbAFAfEreieDdQZ6nYj6kv1oNDNcpoRksFW7-uqEcfVP-dpyttZFy58Rje1XMU8i3MtDevWiFgJhgNzbRLxdZMYDGFz77qoilzpYGOMeZz28AbnFM3aqRwS5mSJBvqhMNdVgpdLw5L_g9lBogLHa10U Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:08:00.174660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19d3583d753d4efab0bcd6769574420b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19d3583d753d4efab0bcd6769574420b"}]}] Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-41102430 Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 326c59915e3d4b7289472d1400730a07 Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.176165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'fdd9048c-290a-4f95-b832-04d69866e0ec'} Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:08:00.176986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.178814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.180386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Returning 404 to user: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:08:00.180386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f573127e-8da9-4d1c-abdd-422eb2035f48 tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "DELETE /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 404 len: 111 microversion: 2.1 time: 0.029840 Sep 09 12:08:00.180386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 164/351] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:08:00 2022] DELETE /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:08:00.184553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:00.185160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] [instance: fdd9048c-290a-4f95-b832-04d69866e0ec] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:00.190896 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.191385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.191829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.192526 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.192987 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.193413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.209978 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] HTTP exception thrown: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Request method failure captured: Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec HTTP/1.1 Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyw4OH62H3tH0erwCEgD6DdmqbAFAfEreieDdQZ6nYj6kv1oNDNcpoRksFW7-uqEcfVP-dpyttZFy58Rje1XMU8i3MtDevWiFgJhgNzbRLxdZMYDGFz77qoilzpYGOMeZz28AbnFM3aqRwS5mSJBvqhMNdVgpdLw5L_g9lBogLHa10U Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:08:00.211541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_19d3583d753d4efab0bcd6769574420b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/19d3583d753d4efab0bcd6769574420b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/19d3583d753d4efab0bcd6769574420b"}]}] Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-DeleteServersTestJSON-41102430 Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 19d3583d753d4efab0bcd6769574420b Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-DeleteServersTestJSON-41102430 Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 326c59915e3d4b7289472d1400730a07 Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-DeleteServersTestJSON-41102430-project Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.213103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'fdd9048c-290a-4f95-b832-04d69866e0ec'} Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:08:00.213907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. Sep 09 12:08:00.215236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:00.216433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] Returning 404 to user: Instance fdd9048c-290a-4f95-b832-04d69866e0ec could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:08:00.216433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2dd16435-036b-42fc-b96d-ad0aff87211b tempest-DeleteServersTestJSON-41102430 tempest-DeleteServersTestJSON-41102430-project] 10.222.0.62 "GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec" status: 404 len: 111 microversion: 2.1 time: 0.031972 Sep 09 12:08:00.216433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 165/352] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:00 2022] GET /compute/v2.1/servers/fdd9048c-290a-4f95-b832-04d69866e0ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:08:00.425037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:00.433378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e9d6644b-b183-4b03-bc45-b6a42587606a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.276567 Sep 09 12:08:00.433950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 188/353] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:00 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:00.804455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:00.805126 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:00.811272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.811992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.812433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.813132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:00.813587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:00.814010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:00.959279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:00.967731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eda0eb5f-fc86-45f8-a6ba-440d8ccc0191 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.167064 Sep 09 12:08:00.968316 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 166/354] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:00 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:01.456182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:01.456790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:01.463315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:01.463803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:01.464244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:01.464937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:01.465394 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:01.465815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:01.673074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:01.680715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1312a35f-83a4-4352-af29-9c0fc850567b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.228477 Sep 09 12:08:01.681288 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 189/355] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:01 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:01.991508 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:01.992231 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:01.998988 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:01.999576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:02.000088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:02.000793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:02.001252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:02.001683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:02.145030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:02.149343 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:02.159549 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-199f432d-9fab-485b-88f0-c1da58b9839c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.171734 Sep 09 12:08:02.160507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 167/356] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:01 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:02.703810 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:02.705065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:02.713396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:02.714086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:02.714772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:02.715581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:02.716366 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:02.716926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:03.023593 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:03.032122 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fea6b871-7a8d-4817-93a8-3ead1ef957d7 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.332269 Sep 09 12:08:03.046357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 190/357] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:02 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:03.187500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:03.188106 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:03.197622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:03.198685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:03.199125 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:03.200012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:03.200464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:03.200883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:03.338545 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:03.348307 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f606fe92-7f05-4ff1-a69b-0f0879dc0a19 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.167087 Sep 09 12:08:03.349258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 168/358] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:03 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:04.056266 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:04.057138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:04.064015 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:04.064661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:04.065205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:04.066024 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:04.066641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:04.067176 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:04.332096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:04.342185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-972b12e4-6b57-47da-94f5-c549ab750a41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.290844 Sep 09 12:08:04.343180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 191/359] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:04 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:04.375970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:04.376651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:04.383773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:04.384276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:04.384786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:04.386158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:04.386630 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:04.387063 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:04.537685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:04.547651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9ccf35a7-5d46-4673-9b90-6956dcbdd6e3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.177804 Sep 09 12:08:04.548056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 169/360] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:04 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:05.364740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:05.365354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:05.371981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:05.372538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:05.372901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:05.373590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:05.374038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:05.374483 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:05.505364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:05.514179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-379b9daf-6c82-4cc9-b49b-8f44e686daa5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.153152 Sep 09 12:08:05.514752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 192/361] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:05 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:05.571312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:05.571924 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:05.578556 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:05.579044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:05.579488 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:05.580183 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:05.580647 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:05.581070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:05.729554 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:05.737708 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a3d353b0-cf8e-407c-ba1d-a1b92c762c69 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.170733 Sep 09 12:08:05.738605 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 170/362] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:05 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:06.540582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:06.541139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:06.572517 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:06.573317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:06.574020 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:06.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:06.575508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:06.576420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:06.734895 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:06.743528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e15e122-4b13-4153-8255-6b2fd1093c41 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.209507 Sep 09 12:08:06.744144 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 193/363] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:06 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:06.761853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:06.762685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:06.768856 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:06.769382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:06.769854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:06.770649 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:06.771156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:06.771586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:06.905944 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:06.913641 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e10254b7-e1d6-4fa6-80f1-1c74583429ef tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.155747 Sep 09 12:08:06.914233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 171/364] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:06 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:07.767987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:07.768594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:07.775108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:07.775589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:07.776045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:07.776705 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:07.777161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:07.779232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:07.936886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:07.937489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:07.944734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:07.945229 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:07.945666 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:07.946401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:07.946854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:07.947288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:07.958244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:07.966767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a04ef8e8-253f-4367-ba55-5bd0819a09db tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.203426 Sep 09 12:08:07.967357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 194/365] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:07 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:08.075052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:08.082550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3714247b-f5f8-4144-b528-75cba576496d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.149657 Sep 09 12:08:08.083160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 172/366] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:07 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:08.384991 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d7bc5187-4dec-48d5-8e25-2973226771c9 req-6c4c0e0c-6611-41da-9a9f-2123fc2cfe9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fde5d77-c665-4957-8cf5-7bb6bd4b62ca", "name": "network-vif-plugged", "status": "completed", "tag": "abd2b4c0-a0ae-48e9-bd59-a74703c02c14"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:08.395211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7bc5187-4dec-48d5-8e25-2973226771c9 req-6c4c0e0c-6611-41da-9a9f-2123fc2cfe9f service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:08.395640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7bc5187-4dec-48d5-8e25-2973226771c9 req-6c4c0e0c-6611-41da-9a9f-2123fc2cfe9f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:08.396072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d7bc5187-4dec-48d5-8e25-2973226771c9 req-6c4c0e0c-6611-41da-9a9f-2123fc2cfe9f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:08.407958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d7bc5187-4dec-48d5-8e25-2973226771c9 req-6c4c0e0c-6611-41da-9a9f-2123fc2cfe9f service nova] Creating event network-vif-plugged:abd2b4c0-a0ae-48e9-bd59-a74703c02c14 for instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca on hv-cinder-85221 Sep 09 12:08:08.413302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d7bc5187-4dec-48d5-8e25-2973226771c9 req-6c4c0e0c-6611-41da-9a9f-2123fc2cfe9f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032693 Sep 09 12:08:08.414064 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 195/367] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:08:08.988953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:08.989464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:08.996115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:08.996598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:08.997037 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:08.997722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:08.998203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:08.998628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:09.105216 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:09.105912 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:09.112116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:09.112678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:09.113153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:09.113923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:09.114363 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:09.114783 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:09.133078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:09.140970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe95a296-3c44-4d7e-abc9-fb76571d01ae tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.155863 Sep 09 12:08:09.141535 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 173/368] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:08 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:09.247772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:09.255647 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9d0ab45d-d4d5-41b4-8c35-87e703e52330 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.154608 Sep 09 12:08:09.256922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 196/369] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:09 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:10.163808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:10.164443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:10.166789 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=82 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:10.171958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:10.172443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:10.172879 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:10.173560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:10.174012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:10.174458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:10.279295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:10.280004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:10.286627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:10.287116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:10.287612 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:10.288313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:10.289129 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:10.289560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:10.427102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:10.434824 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b14f32b8-552d-422f-b3f8-ad55ff722416 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.159504 Sep 09 12:08:10.435421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 197/370] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:10 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:10.444012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:10.451683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ad8802e-f695-46a2-a281-cfb1db5beb56 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.291773 Sep 09 12:08:10.452228 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 174/371] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:10 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:11.457793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:11.458440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:11.464882 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:11.465355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:11.465780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:11.466488 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:11.466936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:11.467353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:11.475713 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:11.476325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:11.483227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:11.483717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:11.484154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:11.484852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:11.485308 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:11.485736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:11.597634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:11.600735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:11.608198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f69742c-17c4-4d2e-a2e1-ff157305b58e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.154150 Sep 09 12:08:11.608782 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 198/372] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:11 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:11.620487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:11.628177 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5852872d-0768-4d32-b0b7-9a400a2ff39b tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.157601 Sep 09 12:08:11.628759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 175/373] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:11 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:12.631954 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:12.632573 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:12.638455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:12.638959 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:12.639390 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:12.640069 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:12.640519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:12.640934 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:12.650156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:12.650894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:12.656963 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:12.657450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:12.657890 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:12.658609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:12.659065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:12.659489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:12.773232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:12.780951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42d7c7bb-d3da-4553-92e3-1090f882b5e2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.153073 Sep 09 12:08:12.781520 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 199/374] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:12 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:12.791892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:12.799745 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0484633e-93d7-45c3-9023-6bfa31358036 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.153291 Sep 09 12:08:12.800255 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 176/375] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:12 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:13.804572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:13.805178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:13.811349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:13.812204 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:13.812356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:13.812960 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:13.813421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:13.813841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:13.823085 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:13.825400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:13.830468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:13.830915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:13.831311 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:13.832182 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:13.832636 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:13.833278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:13.976532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:13.984371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b46cc7d9-e531-497d-a3f4-34dd38570251 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.165841 Sep 09 12:08:13.998297 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 177/376] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:13 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:14.015713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:14.023979 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d720d3de-c700-4dd9-b767-bf02b5d2230f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1522 microversion: 2.1 time: 0.223226 Sep 09 12:08:14.023979 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 200/377] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:13 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:15.008402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:15.009048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:15.016837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:15.017283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:15.017715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:15.018439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:15.018892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:15.019309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:15.045878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:15.046526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:15.057984 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:15.058513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:15.059146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:15.060026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:15.060649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:15.061132 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:15.182688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:15.190503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0ecfd393-b311-4057-87d3-dd28881d9070 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.186267 Sep 09 12:08:15.191070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 178/378] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:15 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:15.226817 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:15.235862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83a3b258-c690-4168-9e5d-c2812a8de7a8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1502 microversion: 2.1 time: 0.193658 Sep 09 12:08:15.236498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 201/379] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:15 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:15.260737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:15.261634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:15.268011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:15.268767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:15.269398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:15.270391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:15.271027 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:15.271854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:15.442797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:15.450942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0e5ee2bd-60bf-4a4c-ba38-18a891804ffc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1516 microversion: 2.1 time: 0.194756 Sep 09 12:08:15.451499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 179/380] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:15 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:16.213291 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:16.213899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:16.221318 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:16.221923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:16.222715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:16.223439 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:16.224080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:16.224575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:16.358862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:16.366473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c76e42c1-c052-4fac-a874-74b99b25a909 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.157555 Sep 09 12:08:16.367045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 202/381] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:16 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:17.389856 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:17.390524 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:17.397428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:17.397917 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:17.398378 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:17.399067 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:17.399520 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:17.399939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:17.532861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:17.541248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ca27da2-2a4c-4546-a787-94d3388e852e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.155164 Sep 09 12:08:17.541783 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 180/382] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:17 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:18.563379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:18.563985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:18.566352 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:18.571880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:18.572372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:18.572807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:18.573504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:18.573955 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:18.574405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:18.702404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:18.710036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-826a416d-91b5-44bf-84db-c678abee2835 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.150484 Sep 09 12:08:18.710625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 203/383] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:18 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:19.732771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:19.733407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:19.739828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:19.740898 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:19.741324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:19.742003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:19.742492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:19.742909 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:19.868746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:19.877200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7924bbfb-fa5e-448f-b63e-5ce87caf9965 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.148180 Sep 09 12:08:19.877786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 181/384] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:19 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:20.903620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:20.904230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:20.910351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:20.910842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:20.911276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:20.911971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:20.912428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:20.912851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:21.051576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:21.059715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f91b878-2186-4a25-9788-b85164b811e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1313 microversion: 2.1 time: 0.160007 Sep 09 12:08:21.060282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 204/385] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:20 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:22.090332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:22.090332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:22.092298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.092795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.093288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.093994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.094739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.095729 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.101837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:22.104123 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:22.111399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.111899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.112337 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.113042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.113498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.113925 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.142848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lazy-loading 'flavor' on Instance uuid f58b3ed3-4531-4074-9b0d-f23702ea7732 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:08:22.239918 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6be6f442-7219-41be-a8a4-900b5f767f93 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732/action" status: 200 len: 32 microversion: 2.1 time: 0.142467 Sep 09 12:08:22.244868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 205/386] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:08:22 2022] POST /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 12:08:22.251652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:22.252356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:22.261495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.262073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.262585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.263429 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.263890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.264334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.283610 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:22.296176 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60d24833-7833-4138-8559-28e1ec8f7c2f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1497 microversion: 2.1 time: 0.216609 Sep 09 12:08:22.297271 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 182/387] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:22 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:22.432490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:22.440750 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3a2adab-8d59-41f0-98ce-396ed6700f30 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.193464 Sep 09 12:08:22.441410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 206/388] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:22 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:22.856220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:22.866713 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:22.883186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.883680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.884283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.885186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:22.885924 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:22.892284 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:22.926180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:08:22.962300 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:23.063237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d709ea8b-97fb-48aa-9118-6a98d6a01a8c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 204 len: 0 microversion: 2.1 time: 0.210567 Sep 09 12:08:23.063819 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 183/389] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:08:22 2022] DELETE /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:08:23.072538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:23.074310 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:23.086310 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:23.086406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:23.086798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:23.087500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:23.087969 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:23.088393 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:23.254966 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:23.262837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec43eacb-871d-4224-bd6d-56b79624d0ec tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1503 microversion: 2.1 time: 0.194544 Sep 09 12:08:23.263422 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 207/390] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:23 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:23.466388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:23.467118 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:23.475131 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:23.475437 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:23.475871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:23.476578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:23.477028 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:23.477454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:23.680076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:23.687667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1eff960d-4cf9-4c71-bc07-74e448efbae6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.225823 Sep 09 12:08:23.688238 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 184/391] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:23 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:24.286348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:24.287036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:24.293726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:24.294235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:24.294665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:24.295350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:24.295802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:24.296215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:24.436103 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:24.443833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61aa00dd-fa91-49ca-b00f-3b96a3a14852 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1503 microversion: 2.1 time: 0.161348 Sep 09 12:08:24.444406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 208/392] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:24 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:24.711847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:24.713236 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:24.720694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:24.721379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:24.721821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:24.722551 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:24.723027 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:24.723440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:24.867292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:24.875299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7d104b3-433b-4b9b-8d85-4e131eed9087 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.168130 Sep 09 12:08:24.875861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 185/393] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:24 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:25.466926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:25.467451 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:25.473451 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:25.473936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:25.474914 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:25.475781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:25.476244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:25.476669 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:25.607415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:25.615013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8964b89-2381-4219-9f28-4385c0bf5acf tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1503 microversion: 2.1 time: 0.151987 Sep 09 12:08:25.615565 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 209/394] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:25 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:25.899490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:25.900105 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:25.906972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:25.907440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:25.907878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:25.908587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:25.909043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:25.909470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:26.053521 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:26.061348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7fb9536-4e60-45b3-ae19-be3a8a30a819 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.166273 Sep 09 12:08:26.061909 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 186/395] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:25 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:26.638436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:26.639079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:26.645298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:26.645784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:26.646266 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:26.646964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:26.647423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:26.647852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:26.782237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:26.790460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ba2982c5-cb82-4e84-9d6b-cc485d9493bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1503 microversion: 2.1 time: 0.156069 Sep 09 12:08:26.791069 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 210/396] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:26 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:27.085134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:27.085741 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:27.092192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:27.092679 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:27.093115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:27.093810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:27.094309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:27.094739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:27.229403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:27.237998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfffba7e-cbc3-4f70-8130-a9dab9dac469 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.157196 Sep 09 12:08:27.238657 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 187/397] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:27 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:27.814351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:27.814964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:27.821711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:27.822236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:27.822676 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:27.823389 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:27.823841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:27.824260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:27.957863 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:27.965894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-574a249e-6dbe-4caf-99e3-cd2342f81ea2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1503 microversion: 2.1 time: 0.155430 Sep 09 12:08:27.966508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 211/398] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:27 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:28.261614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:28.262248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:28.268702 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:28.269183 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:28.269617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:28.270335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:28.270791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:28.271221 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:28.403816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:28.412166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3fcf3683-d1e4-46d8-87a0-826d304ad76b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.153799 Sep 09 12:08:28.412726 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 188/399] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:28 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:28.988734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:28.989441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:28.996080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:28.996565 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:28.997003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:28.997716 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:28.998173 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:28.998602 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:29.127763 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:29.135916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04bbbb96-0bb6-4e86-b5c2-bed406a0bd3d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1503 microversion: 2.1 time: 0.151619 Sep 09 12:08:29.136479 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 212/400] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:28 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:29.434376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:29.434991 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:29.441547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:29.442039 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:29.442515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:29.443814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:29.444292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:29.444892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:29.645516 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:29.655109 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf9fb69c-5169-484f-942b-f324cd0b26ea tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.224472 Sep 09 12:08:29.655802 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 189/401] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:29 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:29.807214 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c8cd725e-7d29-4e8c-a274-7e6565fee4a8 req-1b02c94c-abc0-4813-9825-83005c0569a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fde5d77-c665-4957-8cf5-7bb6bd4b62ca", "name": "network-vif-deleted", "tag": "abd2b4c0-a0ae-48e9-bd59-a74703c02c14"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:29.816657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c8cd725e-7d29-4e8c-a274-7e6565fee4a8 req-1b02c94c-abc0-4813-9825-83005c0569a7 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:29.817136 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c8cd725e-7d29-4e8c-a274-7e6565fee4a8 req-1b02c94c-abc0-4813-9825-83005c0569a7 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:29.817566 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c8cd725e-7d29-4e8c-a274-7e6565fee4a8 req-1b02c94c-abc0-4813-9825-83005c0569a7 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:29.829450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c8cd725e-7d29-4e8c-a274-7e6565fee4a8 req-1b02c94c-abc0-4813-9825-83005c0569a7 service nova] Creating event network-vif-deleted:abd2b4c0-a0ae-48e9-bd59-a74703c02c14 for instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca on hv-cinder-85221 Sep 09 12:08:29.834717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c8cd725e-7d29-4e8c-a274-7e6565fee4a8 req-1b02c94c-abc0-4813-9825-83005c0569a7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 Sep 09 12:08:29.835397 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 213/402] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:08:30.159529 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:30.160279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:30.167932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:30.168426 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:30.168878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:30.170611 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:30.171101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:30.171539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:30.212549 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:30.213002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:30.213435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:30.213891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lazy-loading 'fault' on Instance uuid 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:08:30.267763 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:30.275919 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7cc6770b-5a94-4fd9-8efa-467740f0cb0e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 200 len: 1303 microversion: 2.1 time: 0.120676 Sep 09 12:08:30.276490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 190/403] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:30 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:30.685829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:30.686737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:30.694207 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:30.695035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:30.695940 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:30.697211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:30.698047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:30.698687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:30.728168 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:30.856349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:30.863922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec663489-51b8-450a-9297-ae95722a92f6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.188119 Sep 09 12:08:30.864477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 214/404] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:30 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:31.298502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:31.299115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:31.305582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:31.306062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:31.306562 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:31.307251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:31.307707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:31.308135 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:31.321893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] HTTP exception thrown: Instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca could not be found. Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Request method failure captured: Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca HTTP/1.1 Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyyOp-0RySm9qnAt7-BLr1nx5TAvDLnmzxf3JOuZtqZU_ULE_qlsXOx6BCIEOyC_rvChDu-71-Ak9Uxo65lFqyGKoNIjE4SmNtJ0gupZr3urimwKuMMJLUVB7DrVkEaFckgugY8MeQAFt3JrnLYgDett7qiC-G4psAwShcwDXLcgE7E Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: f85c5e478d5c4efca84cb570537ea15d Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesActionsTest-1686475196 Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:08:31.323559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f85c5e478d5c4efca84cb570537ea15d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f85c5e478d5c4efca84cb570537ea15d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f85c5e478d5c4efca84cb570537ea15d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f85c5e478d5c4efca84cb570537ea15d"}]}] Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesActionsTest-1686475196 Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: f85c5e478d5c4efca84cb570537ea15d Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesActionsTest-1686475196 Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesActionsTest-1686475196-project Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: eef1afc3ece940248494501dd27e3920 Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesActionsTest-1686475196-project Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca could not be found. Sep 09 12:08:31.324916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '4fde5d77-c665-4957-8cf5-7bb6bd4b62ca'} Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca could not be found. Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:08:31.325642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca could not be found. Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca could not be found. Sep 09 12:08:31.327002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:31.328251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Returning 404 to user: Instance 4fde5d77-c665-4957-8cf5-7bb6bd4b62ca could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:08:31.328251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0efba41-8a31-4f1f-a12b-381644f1b58a tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca" status: 404 len: 111 microversion: 2.1 time: 0.030330 Sep 09 12:08:31.328251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 191/405] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:31 2022] GET /compute/v2.1/servers/4fde5d77-c665-4957-8cf5-7bb6bd4b62ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:08:31.428103 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1144665369", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "networks": [{"uuid": "308ada5c-f0ed-4ca7-89ad-19e4711c1427"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:31.481663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] validate_networks() for [('308ada5c-f0ed-4ca7-89ad-19e4711c1427', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:08:31.825106 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:08:31.825590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:08:31.825990 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:08:31.826508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:08:31.826921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:08:31.835905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:31.836387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:31.836818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:31.837551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:31.838007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:31.838461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:31.855450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Getting quotas for project f85c5e478d5c4efca84cb570537ea15d. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:08:31.859691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Getting quotas for user eef1afc3ece940248494501dd27e3920 and project f85c5e478d5c4efca84cb570537ea15d. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:08:31.871590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:08:31.873975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:08:31.888615 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:31.889619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:31.896156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:31.896958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:31.897487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:31.898449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:31.898842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:31.899413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:31.921527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fc02af28-2ea9-4f62-a1ce-15030e87c76f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497232 Sep 09 12:08:31.922508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 215/406] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:08:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:08:31.933992 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7c723c8a-ffda-4581-b657-4cf0b049d65d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:31.934750 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7c723c8a-ffda-4581-b657-4cf0b049d65d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:31.993626 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7c723c8a-ffda-4581-b657-4cf0b049d65d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:32.002290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7c723c8a-ffda-4581-b657-4cf0b049d65d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1214 microversion: 2.1 time: 0.072318 Sep 09 12:08:32.003047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 216/407] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:31 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:32.059640 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:32.068276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c96df809-d9c6-414c-a108-7a304ae188fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.183610 Sep 09 12:08:32.069005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 192/408] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:31 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:33.025741 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:33.026522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:33.034164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:33.034650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:33.035078 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:33.035779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:33.036224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:33.036637 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:33.091606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:33.092222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:33.098940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:33.099433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:33.099870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:33.099999 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:33.100574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:33.101069 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:33.101500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:33.107753 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-402e0126-97c5-4a2d-8074-6095aee481c4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1218 microversion: 2.1 time: 0.086657 Sep 09 12:08:33.108329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 217/409] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:33 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:33.229231 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:33.236864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0756a03-ad48-4408-8b8c-b5e5a072c2d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.149144 Sep 09 12:08:33.237417 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 193/410] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:33 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:34.131034 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:34.131780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:34.137769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:34.138284 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:34.138720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:34.139403 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:34.139854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:34.140271 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:34.204379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:34.211937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db8185ad-f4fc-4dff-8b6e-1ede22dbf326 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1218 microversion: 2.1 time: 0.084731 Sep 09 12:08:34.212501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 218/411] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:34 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:34.260736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:34.261350 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:34.267840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:34.268333 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:34.268805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:34.269499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:34.269958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:34.270424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:34.401035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:34.408765 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3009368c-275b-44c7-bdd6-7bc701404f3f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.151905 Sep 09 12:08:34.409326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 194/412] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:34 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:35.234704 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:35.235321 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:35.242353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:35.242841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:35.243277 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:35.243967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:35.244423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:35.244848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:35.305561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:35.313199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9b278c79-f89d-4320-a131-bbd4e07085d3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1218 microversion: 2.1 time: 0.082417 Sep 09 12:08:35.313762 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 219/413] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:35 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:35.432698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:35.433234 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:35.439624 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:35.440106 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:35.440593 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:35.441272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:35.441731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:35.442195 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:35.571745 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:35.580231 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-827a5e08-eb83-43f9-b0c5-7077ba2d46bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.152098 Sep 09 12:08:35.580799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 195/414] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:35 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:36.336340 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:36.336952 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:36.342966 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:36.343451 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:36.343886 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:36.344574 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:36.345099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:36.345462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:36.406735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:36.414864 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b218e29c-a476-47ab-93b4-7fa032efeb76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1266 microversion: 2.1 time: 0.082399 Sep 09 12:08:36.415425 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 220/415] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:36 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:36.605118 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:36.605659 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:36.612201 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:36.612742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:36.613174 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:36.613899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:36.614393 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:36.614814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:36.832365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:36.842603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-15340c02-b167-4bbd-8270-5b8405c28793 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.243148 Sep 09 12:08:36.843264 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 196/416] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:36 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:37.438923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:37.440408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:37.458495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:37.458983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:37.460376 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:37.461465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:37.461913 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:37.462372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:37.668282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:37.676917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18ac84af-eaac-4e12-95fe-883747a3b17d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.242716 Sep 09 12:08:37.677491 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 221/417] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:37 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:37.869052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:37.870630 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:37.877783 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:37.878665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:37.879303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:37.879968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:37.880448 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:37.880926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:38.124964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:38.135717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3d09993d-9738-473e-82a7-560849e1c19e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.270959 Sep 09 12:08:38.152769 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 197/418] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:37 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:38.381291 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-86c76fb5-abd0-4799-a737-c759903fd87d req-4df15747-b48b-4bb4-95f2-e27c18e16b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "197b948c-e11c-48ad-89f2-76fc12b7357a", "tag": "9a87c935-3501-4440-8bdc-f5676e1f59a7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:38.436936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-86c76fb5-abd0-4799-a737-c759903fd87d req-4df15747-b48b-4bb4-95f2-e27c18e16b69 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:38.438240 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-86c76fb5-abd0-4799-a737-c759903fd87d req-4df15747-b48b-4bb4-95f2-e27c18e16b69 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:38.438888 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-86c76fb5-abd0-4799-a737-c759903fd87d req-4df15747-b48b-4bb4-95f2-e27c18e16b69 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:38.461142 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-86c76fb5-abd0-4799-a737-c759903fd87d req-4df15747-b48b-4bb4-95f2-e27c18e16b69 service nova] Creating event network-changed:9a87c935-3501-4440-8bdc-f5676e1f59a7 for instance 197b948c-e11c-48ad-89f2-76fc12b7357a on hv-cinder-85221 Sep 09 12:08:38.467297 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-86c76fb5-abd0-4799-a737-c759903fd87d req-4df15747-b48b-4bb4-95f2-e27c18e16b69 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090814 Sep 09 12:08:38.468063 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 222/419] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:08:38.702176 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:38.702176 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:38.707769 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:38.708259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:38.708701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:38.709401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:38.709966 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:38.710788 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:39.109541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:39.117741 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1dcfac36-5ce0-4ce1-93d2-128d4ad68f6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.421256 Sep 09 12:08:39.118328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 198/420] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:38 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:39.162523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:39.163370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:39.169994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:39.171143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:39.171143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:39.171899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:39.172350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:39.173342 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:39.348947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:39.357219 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ac8a742-ee44-4d8c-be9d-4c748dcec2b8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.200837 Sep 09 12:08:39.357791 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 223/421] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:39 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:40.141727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:40.142473 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:40.150235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:40.150734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:40.151173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:40.151889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:40.152355 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:40.152783 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:40.287170 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:40.289443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:40.296943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7cbadfd0-ef26-44a8-83e9-f85edbb1f6e3 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.159168 Sep 09 12:08:40.297511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 199/422] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:40 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:40.381388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:40.382612 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:40.388538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:40.389011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:40.389438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:40.390131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:40.390588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:40.391146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:40.524529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:40.532259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eee85bc8-df5f-4e6e-ab8e-f6a0e7b8f323 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.154729 Sep 09 12:08:40.532818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 224/423] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:40 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:41.320319 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:41.320955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:41.323580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:41.330905 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:41.331516 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:41.331958 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:41.332652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:41.333113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:41.333537 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:41.462895 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:41.472625 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b99245f8-ea0b-4064-af38-0aeb4dff0e82 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.156296 Sep 09 12:08:41.473606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 200/424] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:41 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:41.555678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:41.556487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:41.562533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:41.563010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:41.563433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:41.564105 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:41.564577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:41.564993 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:41.696596 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:41.704202 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e049c0d9-71fb-42ce-9852-08c9be480bd8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.153296 Sep 09 12:08:41.704764 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 225/425] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:41 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:42.498182 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:42.498792 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:42.505144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:42.505627 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:42.506055 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:42.506766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:42.507219 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:42.507646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:42.639093 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:42.647071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ef0bec7e-3bef-4674-b494-4c9188a23956 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.153144 Sep 09 12:08:42.647727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 201/426] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:42 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:42.727488 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:42.728090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:42.730025 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:42.730722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:42.736579 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:42.737056 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:42.737483 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:42.738187 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:42.738636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:42.739050 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:42.871279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:42.879172 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3297fd17-1611-4848-8c76-730c41bc67d1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.156085 Sep 09 12:08:42.879733 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 226/427] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:42 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:43.670317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:43.670981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:43.677324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:43.677795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:43.678260 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:43.679031 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:43.679483 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:43.679902 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:43.810204 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:43.817825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2f94b819-6d8e-4767-9699-34b8aa3895c5 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.151377 Sep 09 12:08:43.818421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 202/428] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:43 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:43.903165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:43.903803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:43.909815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:43.910331 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:43.910768 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:43.911455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:43.911907 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:43.912330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:44.039883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:44.047712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-83039ef4-5d76-43d5-8733-26b05760d7c6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.148414 Sep 09 12:08:44.048278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 227/429] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:43 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:44.840357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:44.841003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:44.847444 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:44.847926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:44.848360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:44.849043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:44.849497 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:44.849920 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:44.981095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:44.989213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50646359-4976-4add-8745-6163bf421ea9 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.152673 Sep 09 12:08:44.989815 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 203/430] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:44 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:45.073910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:45.074577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:45.080603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:45.081087 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:45.081525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:45.082241 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:45.082700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:45.083132 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:45.213198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:45.221080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-166d0f98-a63d-44a1-b9a2-68f0a2999a33 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.152286 Sep 09 12:08:45.221529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 228/431] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:45 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:46.013569 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:46.014344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:46.022283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:46.022808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:46.023251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:46.024282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:46.024399 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:46.024822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:46.170792 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:46.179348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0aa2fc14-e5af-4431-9e0c-ecab2bb7ed76 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.169148 Sep 09 12:08:46.180070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 204/432] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:46 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:46.245001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:46.245879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:46.252034 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:46.252519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:46.253061 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:46.253642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:46.254096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:46.254748 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:46.385478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:46.393350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a8bf39a8-f4f8-40de-a5ba-0d863c816edf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.153097 Sep 09 12:08:46.393920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 229/433] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:46 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:47.201223 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:47.201857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:47.208346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:47.208829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:47.209256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:47.210637 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:47.211095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:47.211516 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:47.416540 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:47.417334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:47.423436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:47.424000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:47.424509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:47.425290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:47.425819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:47.426374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:47.429979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:47.438177 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bbfe1aa-bc27-4ff3-af37-b42575506005 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.240838 Sep 09 12:08:47.438754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 205/434] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:47 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:47.573517 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:47.582374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a39c662-60a2-4ef2-9dff-fd7f6b93ec42 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.169988 Sep 09 12:08:47.583194 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 230/435] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:47 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:48.468337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:48.469541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:48.477570 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:48.478379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:48.479090 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:48.479888 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:48.480445 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:48.480955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:48.608574 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:48.610199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:48.616017 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:48.618448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:48.619201 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:48.619821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:48.620897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:48.621426 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:48.621926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:48.641623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:48.650987 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-154abf1e-fc7b-4ca4-913d-c27e80adfa7c tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.188208 Sep 09 12:08:48.651786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 206/436] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:48 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:48.769822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:48.778790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-da73f133-31be-4859-8a71-3e25a4b398dd tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.173874 Sep 09 12:08:48.779364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 231/437] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:48 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:49.676838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:49.678137 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:49.686263 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:49.686759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:49.687198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:49.688468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:49.689413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:49.689854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:49.803728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:49.805234 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:49.815009 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:49.816070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:49.816874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:49.818492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:49.819151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:49.819766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:49.861102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:49.869449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae09f7db-3433-4895-b786-9fbe59e08667 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.198007 Sep 09 12:08:49.873082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 207/438] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:49 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:49.932514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f87195df-215d-4a71-a384-e882f62a59d0 req-75645e72-3963-46b5-9670-a8c8f1268038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197b948c-e11c-48ad-89f2-76fc12b7357a", "name": "network-vif-plugged", "status": "completed", "tag": "9a87c935-3501-4440-8bdc-f5676e1f59a7"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:49.943612 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f87195df-215d-4a71-a384-e882f62a59d0 req-75645e72-3963-46b5-9670-a8c8f1268038 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:49.945193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f87195df-215d-4a71-a384-e882f62a59d0 req-75645e72-3963-46b5-9670-a8c8f1268038 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:49.945724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f87195df-215d-4a71-a384-e882f62a59d0 req-75645e72-3963-46b5-9670-a8c8f1268038 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:49.960795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f87195df-215d-4a71-a384-e882f62a59d0 req-75645e72-3963-46b5-9670-a8c8f1268038 service nova] Creating event network-vif-plugged:9a87c935-3501-4440-8bdc-f5676e1f59a7 for instance 197b948c-e11c-48ad-89f2-76fc12b7357a on hv-cinder-85221 Sep 09 12:08:49.967176 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f87195df-215d-4a71-a384-e882f62a59d0 req-75645e72-3963-46b5-9670-a8c8f1268038 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039281 Sep 09 12:08:49.968386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 208/439] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:08:49.996552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:50.004457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cfe2e20c-a6cc-4abd-a8a5-8c8b031f516f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.205086 Sep 09 12:08:50.005012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 232/440] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:49 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:50.900576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:50.901260 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:50.908821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:50.909922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:50.910396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:50.911099 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:50.911687 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:50.912127 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:51.028979 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:51.029588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:51.036011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:51.036702 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:51.037373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:51.038907 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:51.039693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:51.040121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:51.045650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:51.115928 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:51.134868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-73e6944c-c06b-458a-9d88-67c55932dfb8 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.236180 Sep 09 12:08:51.137686 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 209/441] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:50 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:51.188942 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:51.198705 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5c91c4a-62c6-4fa6-9f75-f8cc0b3a88ce tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.173409 Sep 09 12:08:51.199314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 233/442] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:51 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:52.158270 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:52.158869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:52.165197 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.165680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.166143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.166978 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.167442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.167870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.221855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:52.222499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:52.228787 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.229280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.229719 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.230452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.230910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.231339 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.298857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:52.306702 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93424f7d-b1de-4731-a27c-20651c753a6e tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.152173 Sep 09 12:08:52.307275 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 210/443] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:52 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:52.359053 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:52.366737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eb292507-8e03-4ac9-83a7-7a3f44d8028a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1502 microversion: 2.1 time: 0.148741 Sep 09 12:08:52.367304 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 234/444] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:52 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:52.389860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f258e25-da71-4fb0-b76f-77fbbdbe178b"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:52.392262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:52.398806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.399289 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.399726 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.400413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.400868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.401292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.424297 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] HTTP exception thrown: Cannot 'attach_volume' instance f58b3ed3-4531-4074-9b0d-f23702ea7732 while it is in vm_state rescued Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Request method failure captured: Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732/os-volume_attachments HTTP/1.1 Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 74 Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyw6FWacK_GcSBnmrWuFi4XbfuxIBxobdXnovNrmDXUPO89-OOKUtMPcGhwLEunsRbOLc5glqqdYvnHa3lHfDej0gumsCdYFKI4kUxiL9PXiwD4fE6yC1FhtPRIlP7d97bkJx3cccrs9BGQfM-hX_PmRdSDFpob4bC5QmaybY-i91SE Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:08:52.425992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9860574ff3947e3bc61a76e6883107a"}]}] Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 9c0f1bfeb1464f87a7f3ea4add940861 Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {"volumeAttachment": {"volumeId": "3f258e25-da71-4fb0-b76f-77fbbdbe178b"}} Sep 09 12:08:52.427885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Cannot 'attach_volume' instance f58b3ed3-4531-4074-9b0d-f23702ea7732 while it is in vm_state rescued Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'server_id': 'f58b3ed3-4531-4074-9b0d-f23702ea7732', 'body': {'volumeAttachment': {'volumeId': '3f258e25-da71-4fb0-b76f-77fbbdbe178b'}}} Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f58b3ed3-4531-4074-9b0d-f23702ea7732 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:08:52.428953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f58b3ed3-4531-4074-9b0d-f23702ea7732 while it is in vm_state rescued Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:08:52.430506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:08:52.432871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:08:52.432871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:08:52.432871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f58b3ed3-4531-4074-9b0d-f23702ea7732 while it is in vm_state rescued Sep 09 12:08:52.432871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:08:52.432871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Returning 409 to user: Cannot 'attach_volume' instance f58b3ed3-4531-4074-9b0d-f23702ea7732 while it is in vm_state rescued {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:08:52.432871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-eeb61ff4-0739-4cdc-b6e8-dc3ed4fbf929 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041586 Sep 09 12:08:52.432871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 211/445] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:08:52 2022] POST /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 09 12:08:52.438641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:08:52.439330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:52.445964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.446546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.447072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.447904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.448518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.449013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.516892 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe4b8eaf-9ae2-40f9-9b62-6876ef6760d9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732/action" status: 202 len: 0 microversion: 2.1 time: 0.083494 Sep 09 12:08:52.517514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 235/446] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:08:52 2022] POST /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:08:52.525813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:52.526454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:52.532336 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.533159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.533701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.534563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:52.535021 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:52.535496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:52.671945 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:52.680576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6ab58dd-09c0-4496-9086-3d6eacd41280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1510 microversion: 2.1 time: 0.158484 Sep 09 12:08:52.681313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 212/447] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:52 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:53.330679 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:53.331384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:53.338293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:53.338786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:53.339829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:53.339982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:53.340453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:53.341031 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:53.477293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:53.484968 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5b5bb9b-4efe-4e98-add1-3813fb19ca54 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1314 microversion: 2.1 time: 0.158753 Sep 09 12:08:53.485528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 236/448] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:53 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:53.707528 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:53.708081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:53.714453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:53.714937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:53.715439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:53.716291 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:53.716775 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:53.717338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:53.849589 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:53.859655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-382a92c1-a214-42d4-82cb-e0ac5377683d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1510 microversion: 2.1 time: 0.156057 Sep 09 12:08:53.860234 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 213/449] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:53 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:54.508905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:54.509521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:54.515884 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:54.516373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:54.516805 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:54.517502 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:54.517959 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:54.518433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:54.648445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:54.657202 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d2f28f7f-e2d3-45f3-abb7-26f77fa00411 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1499 microversion: 2.1 time: 0.152172 Sep 09 12:08:54.657782 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 237/450] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:54 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:54.887533 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:54.887533 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:54.895001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:54.895525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:54.896102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:54.897396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:54.898574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:54.899191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:55.029811 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:55.037826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-466d3ee7-2ad3-49c3-ab3c-78ba2556faaa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1510 microversion: 2.1 time: 0.156851 Sep 09 12:08:55.038922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 214/451] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:54 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:55.254088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:55.254828 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:55.261064 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:55.261560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:55.261994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:55.262718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:55.263171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:55.263586 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:55.290424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:08:55.371002 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a48cefa8-bce8-4749-9014-5ba5dd94a9f4 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "DELETE /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 204 len: 0 microversion: 2.1 time: 0.120022 Sep 09 12:08:55.371760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 238/452] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:08:55 2022] DELETE /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:08:55.380309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:55.381051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:55.387900 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:55.388492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:55.388836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:55.389540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:55.389995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:55.390448 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:55.521733 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:55.530304 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-adb93066-70e7-40ae-acc2-edd9e0d272ff tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1505 microversion: 2.1 time: 0.154067 Sep 09 12:08:55.530891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 215/453] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:55 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:08:56.062094 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:56.062820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:56.068883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:56.069371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:56.069923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:56.070656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:56.071112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:56.071541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:56.218990 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:56.236474 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a475acc3-5a81-4ab4-8e5f-7dd4455212c5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1510 microversion: 2.1 time: 0.179063 Sep 09 12:08:56.237066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 239/454] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:56 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:56.554682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:56.555295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:56.561551 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:56.562334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:56.562779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:56.563485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:56.563940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:56.564363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:56.701388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:56.709453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6328b57d-f160-429d-9c10-5251b44db511 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1505 microversion: 2.1 time: 0.159280 Sep 09 12:08:56.710748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 216/455] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:56 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:57.260319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:57.261181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:57.267270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:57.267687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:57.268126 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:57.268819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:57.269279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:57.269703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:57.412154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:57.420513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6dccd229-0c35-431d-9650-e81e180fb067 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1510 microversion: 2.1 time: 0.164436 Sep 09 12:08:57.421070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 240/456] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:57 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:57.736622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:57.737217 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:57.743691 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:57.744182 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:57.744617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:57.745573 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:57.746030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:57.746552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:57.763372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:08:57.883660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:57.891807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30af521c-b558-4355-bbfa-588423ac5a9d tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1505 microversion: 2.1 time: 0.159013 Sep 09 12:08:57.892381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 217/457] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:57 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:58.443237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:58.443845 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:58.449958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:58.450487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:58.450926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:58.451668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:58.452123 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:58.452548 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:58.581557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:58.589236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05e4970c-475f-4073-8995-40c7d31101bc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1510 microversion: 2.1 time: 0.149889 Sep 09 12:08:58.589803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 241/458] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:58 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:58.916517 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:58.917124 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:58.923484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:58.923961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:58.924400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:58.925083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:58.925538 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:58.925960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:59.054739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:59.062335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0745f36-76d1-42c7-aef6-f9563ae42bbe tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1505 microversion: 2.1 time: 0.150268 Sep 09 12:08:59.062896 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 218/459] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:58 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:08:59.611866 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:08:59.612617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:08:59.618675 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:59.619180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:59.619580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:59.620515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:08:59.620961 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:08:59.621374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:08:59.754457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:08:59.761981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-30317152-4c46-4ebb-83f5-1caebb096bf3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1516 microversion: 2.1 time: 0.153908 Sep 09 12:08:59.762575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 242/460] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:08:59 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:00.085045 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:00.085658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:00.092431 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:00.092924 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:00.093368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:00.094056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:00.094540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:00.094975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:00.226160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:00.233882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b7cf1e0b-2f8d-4027-9604-4147da02e2a2 tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1505 microversion: 2.1 time: 0.152922 Sep 09 12:09:00.234476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 219/461] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:00 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:01.033470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-d77ad3a4-5d34-4f13-afc1-64b9ef6f340a req-066a3f57-e628-46be-8d36-eccacff63398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "197b948c-e11c-48ad-89f2-76fc12b7357a", "name": "network-vif-deleted", "tag": "9a87c935-3501-4440-8bdc-f5676e1f59a7"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:09:01.046607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d77ad3a4-5d34-4f13-afc1-64b9ef6f340a req-066a3f57-e628-46be-8d36-eccacff63398 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:01.047085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d77ad3a4-5d34-4f13-afc1-64b9ef6f340a req-066a3f57-e628-46be-8d36-eccacff63398 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:01.047515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-d77ad3a4-5d34-4f13-afc1-64b9ef6f340a req-066a3f57-e628-46be-8d36-eccacff63398 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:01.060528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-d77ad3a4-5d34-4f13-afc1-64b9ef6f340a req-066a3f57-e628-46be-8d36-eccacff63398 service nova] Creating event network-vif-deleted:9a87c935-3501-4440-8bdc-f5676e1f59a7 for instance 197b948c-e11c-48ad-89f2-76fc12b7357a on hv-cinder-85221 Sep 09 12:09:01.066109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-d77ad3a4-5d34-4f13-afc1-64b9ef6f340a req-066a3f57-e628-46be-8d36-eccacff63398 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035844 Sep 09 12:09:01.068674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 243/462] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:09:01.155351 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9a46bb1e-efd7-43e3-9ee7-21fee2284e8b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'create', calling method: .version_select at 0x7ff2d93eac10>, body: {"keypair": {"name": "tempest-keypair-2007364621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1dLFoCPZswGQXBr0/Mx8lZ7YU6AFTE6doQ6H6gicq3FYzOFCwHsufdDTGz8CBdyEODCJ+FFFj/BfmgKHpEy5KTMvn8r6c8Q4sFMkjBY4u+zMvcSqZkvwOLXkjDU9VcIQ=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:09:01.172591 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-9a46bb1e-efd7-43e3-9ee7-21fee2284e8b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for project c9860574ff3947e3bc61a76e6883107a. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:09:01.176617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-9a46bb1e-efd7-43e3-9ee7-21fee2284e8b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for user 9c0f1bfeb1464f87a7f3ea4add940861 and project c9860574ff3947e3bc61a76e6883107a. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:09:01.204858 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9a46bb1e-efd7-43e3-9ee7-21fee2284e8b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062781 Sep 09 12:09:01.205466 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 220/463] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:09:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:09:01.258416 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:01.259115 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:01.265415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:01.265901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:01.266357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:01.267229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:01.267839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:01.268446 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:01.303224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:01.303710 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:01.304306 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:01.304753 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lazy-loading 'fault' on Instance uuid 197b948c-e11c-48ad-89f2-76fc12b7357a {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:09:01.358507 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1afc3ece940248494501dd27e3920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f85c5e478d5c4efca84cb570537ea15d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:01.369543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20c26a66-48e3-44e6-8819-e0e2a028d8bd tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 200 len: 1304 microversion: 2.1 time: 0.116377 Sep 09 12:09:01.370660 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 244/464] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:01 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:02.395054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:02.395789 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] [instance: 197b948c-e11c-48ad-89f2-76fc12b7357a] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:02.403009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:02.403584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:02.404029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:02.404731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:02.405191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:02.405619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:02.419608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] HTTP exception thrown: Instance 197b948c-e11c-48ad-89f2-76fc12b7357a could not be found. Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Request method failure captured: Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a HTTP/1.1 Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyyOp-0RySm9qnAt7-BLr1nx5TAvDLnmzxf3JOuZtqZU_ULE_qlsXOx6BCIEOyC_rvChDu-71-Ak9Uxo65lFqyGKoNIjE4SmNtJ0gupZr3urimwKuMMJLUVB7DrVkEaFckgugY8MeQAFt3JrnLYgDett7qiC-G4psAwShcwDXLcgE7E Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: f85c5e478d5c4efca84cb570537ea15d Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesActionsTest-1686475196 Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:09:02.421286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f85c5e478d5c4efca84cb570537ea15d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f85c5e478d5c4efca84cb570537ea15d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f85c5e478d5c4efca84cb570537ea15d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f85c5e478d5c4efca84cb570537ea15d"}]}] Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesActionsTest-1686475196 Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: f85c5e478d5c4efca84cb570537ea15d Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesActionsTest-1686475196 Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesActionsTest-1686475196-project Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: eef1afc3ece940248494501dd27e3920 Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesActionsTest-1686475196-project Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 197b948c-e11c-48ad-89f2-76fc12b7357a could not be found. Sep 09 12:09:02.422968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '197b948c-e11c-48ad-89f2-76fc12b7357a'} Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 197b948c-e11c-48ad-89f2-76fc12b7357a could not be found. Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:09:02.423953 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 197b948c-e11c-48ad-89f2-76fc12b7357a could not be found. Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 197b948c-e11c-48ad-89f2-76fc12b7357a could not be found. Sep 09 12:09:02.425091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:09:02.426139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] Returning 404 to user: Instance 197b948c-e11c-48ad-89f2-76fc12b7357a could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:09:02.426139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92762567-750a-4c55-aab5-36cf2e5e260f tempest-VolumesActionsTest-1686475196 tempest-VolumesActionsTest-1686475196-project] 10.222.0.62 "GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a" status: 404 len: 111 microversion: 2.1 time: 0.031616 Sep 09 12:09:02.426139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 221/465] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:02 2022] GET /compute/v2.1/servers/197b948c-e11c-48ad-89f2-76fc12b7357a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:09:02.629882 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-358588803", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f999017b-0f3c-4e53-b641-07ec705a6546"}], "security_groups": [{"name": "tempest-securitygroup--1809545708"}], "key_name": "tempest-keypair-2007364621", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:09:02.737149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] validate_networks() for [('f999017b-0f3c-4e53-b641-07ec705a6546', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:09:03.176290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:09:03.176744 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:09:03.177378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:09:03.177790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:09:03.178312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:09:03.190053 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:03.190584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:03.191618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:03.192529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:03.192994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:03.193415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:03.212218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for project c9860574ff3947e3bc61a76e6883107a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:09:03.216523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Getting quotas for user 9c0f1bfeb1464f87a7f3ea4add940861 and project c9860574ff3947e3bc61a76e6883107a. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:09:03.233847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:09:03.236206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:09:03.290897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f8d45759-ef8c-411c-a5fa-ff3351b2256d tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.665554 Sep 09 12:09:03.294449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 245/466] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:09:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:09:03.305355 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df6efc34-b86f-4298-b0f4-79f6c1f3f83a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:03.306094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df6efc34-b86f-4298-b0f4-79f6c1f3f83a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:03.385144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-df6efc34-b86f-4298-b0f4-79f6c1f3f83a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:03.392441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df6efc34-b86f-4298-b0f4-79f6c1f3f83a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1245 microversion: 2.1 time: 0.092932 Sep 09 12:09:03.393133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 222/467] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:03 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:04.416254 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:04.416862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:04.423618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:04.424096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:04.424531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:04.425225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:04.425681 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:04.426100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:04.487470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:04.495387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9dfa0d9c-9a23-48c1-a852-1c00f18ca7e9 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1297 microversion: 2.1 time: 0.083752 Sep 09 12:09:04.495965 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 246/468] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:04 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:05.519736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:05.520341 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:05.527473 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:05.527952 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:05.528383 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:05.529072 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:05.529518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:05.529931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:05.590848 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:05.598537 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fb577f2-81ad-4a91-9e90-aa8a27d985fb tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1297 microversion: 2.1 time: 0.082613 Sep 09 12:09:05.599098 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 223/469] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:05 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:06.621777 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:06.622330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:06.628512 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:06.629004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:06.629442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:06.630140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:06.630603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:06.631028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:06.693641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:06.701906 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9370adbe-6469-42f9-ab18-c11323ba76a1 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1297 microversion: 2.1 time: 0.084848 Sep 09 12:09:06.702515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 247/470] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:06 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:07.724576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:07.725223 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:07.731894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:07.732385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:07.732827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:07.733534 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:07.733995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:07.734458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:07.800076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:07.808306 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77fa3a03-35be-4641-a497-4db59f81a383 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1297 microversion: 2.1 time: 0.087637 Sep 09 12:09:07.808871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 224/471] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:07 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:08.832174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:08.832801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:08.839448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:08.839938 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:08.840365 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:08.841133 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:08.841580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:08.841998 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:08.844965 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:08.988288 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:08.997378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e9d8a06-1bab-474a-b27d-4b62322047b5 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.168917 Sep 09 12:09:08.997996 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 248/472] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:08 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:09.613088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-eca063a7-e389-4085-99e2-44fc9ef1733b req-4f1966dd-1ece-4339-8174-a8331cbc6fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072fca7e-cc8f-41e9-9244-26d624d71486", "tag": "7a8a023e-5606-4a22-825d-2444697c029b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:09:09.635853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eca063a7-e389-4085-99e2-44fc9ef1733b req-4f1966dd-1ece-4339-8174-a8331cbc6fde service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:09.636378 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eca063a7-e389-4085-99e2-44fc9ef1733b req-4f1966dd-1ece-4339-8174-a8331cbc6fde service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:09.636813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-eca063a7-e389-4085-99e2-44fc9ef1733b req-4f1966dd-1ece-4339-8174-a8331cbc6fde service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:09.663374 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-eca063a7-e389-4085-99e2-44fc9ef1733b req-4f1966dd-1ece-4339-8174-a8331cbc6fde service nova] Creating event network-changed:7a8a023e-5606-4a22-825d-2444697c029b for instance 072fca7e-cc8f-41e9-9244-26d624d71486 on hv-cinder-85221 Sep 09 12:09:09.672908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-eca063a7-e389-4085-99e2-44fc9ef1733b req-4f1966dd-1ece-4339-8174-a8331cbc6fde service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063295 Sep 09 12:09:09.673667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 225/473] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:09:10.024826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:10.026192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:10.043949 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:10.044500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:10.045029 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:10.045848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:10.046659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:10.047283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:10.222443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:10.232032 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c5c19ed-77d9-4762-a6d4-1794aaeff957 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.214129 Sep 09 12:09:10.246168 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 249/474] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:10 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:11.258064 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:11.258792 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:11.269172 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:11.269660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:11.270141 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:11.270846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:11.271304 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:11.271731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:11.445033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:11.453859 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-38f72c24-4e8c-432e-a4ac-5d61f75865ca tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.200581 Sep 09 12:09:11.454694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 226/475] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:11 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:12.478085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:12.478746 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:12.485359 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:12.485851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:12.486569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:12.487504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:12.488152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:12.488774 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:12.643237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:12.652259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b4b195f1-0310-458b-97b2-f3b878b36faf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.177541 Sep 09 12:09:12.666140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 250/476] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:12 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:13.677805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:13.679683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:13.683026 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:13.684173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:13.690851 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:13.691653 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:13.692354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:13.693362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:13.694070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:13.694577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:13.879821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:13.889362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-277eb0bd-96b7-4d89-9ebb-18b8c5a8cc9b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.216069 Sep 09 12:09:13.890275 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 227/477] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:13 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:09:14.915632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:14.918149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:14.919801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:14.920534 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:14.927594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:14.928091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:14.928531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:14.929249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:14.929711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:14.930158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:15.098973 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:15.107958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-638ef0c6-3007-420a-a382-d4a4555158a4 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.196376 Sep 09 12:09:15.108568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 251/478] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:14 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:16.132768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:16.133508 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:16.140502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:16.140996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:16.141680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:16.142605 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:16.143266 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:16.143903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:16.308016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:16.319498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dca768f9-1436-4060-9580-1fdfae4efa4b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.190140 Sep 09 12:09:16.322733 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 228/479] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:16 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:17.344663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:17.346456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:17.355026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:17.355819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:17.356509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:17.357282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:17.357790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:17.358289 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:17.568473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:17.584692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b7fba872-7468-4d91-a5ec-2124e124ac3b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.244787 Sep 09 12:09:17.586294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 252/480] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:17 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:18.617210 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:18.618075 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:18.635339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:18.637016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:18.637645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:18.638390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:18.639018 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:18.639451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:18.881416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:18.890663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d23ddf8b-61c9-4d37-b14e-c0ba4c77ef11 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.283338 Sep 09 12:09:18.891560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 229/481] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:18 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:19.916441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:19.917998 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:19.924669 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:09:19.926987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:19.928413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:19.929251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:19.930465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:19.931144 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:19.932471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:20.135916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:20.148378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-69a99e71-a1a5-4b9e-9784-d28136d3793a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.239012 Sep 09 12:09:20.148981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 253/482] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:19 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:21.200367 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:21.201032 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:21.215918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:21.216706 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:21.217317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:21.218232 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:21.218838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:21.219416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:21.398406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:21.407663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a4323a93-8208-4851-b62c-13aa2be39f0f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.225752 Sep 09 12:09:21.408450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 230/483] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:21 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:22.372345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8ae9fe52-8ddf-4ac6-8d1e-1d23d6ae65b7 req-0ed78149-8c45-484f-9312-1ef5f78bf561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072fca7e-cc8f-41e9-9244-26d624d71486", "name": "network-vif-plugged", "status": "completed", "tag": "7a8a023e-5606-4a22-825d-2444697c029b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:09:22.388107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ae9fe52-8ddf-4ac6-8d1e-1d23d6ae65b7 req-0ed78149-8c45-484f-9312-1ef5f78bf561 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:22.390793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ae9fe52-8ddf-4ac6-8d1e-1d23d6ae65b7 req-0ed78149-8c45-484f-9312-1ef5f78bf561 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:22.392501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8ae9fe52-8ddf-4ac6-8d1e-1d23d6ae65b7 req-0ed78149-8c45-484f-9312-1ef5f78bf561 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:22.418663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8ae9fe52-8ddf-4ac6-8d1e-1d23d6ae65b7 req-0ed78149-8c45-484f-9312-1ef5f78bf561 service nova] Creating event network-vif-plugged:7a8a023e-5606-4a22-825d-2444697c029b for instance 072fca7e-cc8f-41e9-9244-26d624d71486 on hv-cinder-85221 Sep 09 12:09:22.427860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8ae9fe52-8ddf-4ac6-8d1e-1d23d6ae65b7 req-0ed78149-8c45-484f-9312-1ef5f78bf561 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059643 Sep 09 12:09:22.428798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 254/484] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:09:22.433928 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:22.435846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:22.444678 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:22.446160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:22.446676 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:22.448825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:22.450627 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:22.451015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:22.656799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:22.671220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9d1fbec8-dea4-4bd6-8a7e-d2d3bfcb9557 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.240751 Sep 09 12:09:22.686488 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 231/485] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:22 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:23.695691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:23.696851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:23.704080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:23.707267 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:23.708003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:23.709139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:23.709930 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:23.710596 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:23.867888 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:23.879531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff6523f3-4e19-4b16-810d-ae6c7a4bbf94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.188176 Sep 09 12:09:23.894148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 255/486] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:23 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:24.915015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:24.917553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:24.940251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:24.942348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:24.943183 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:24.944140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:24.944806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:24.945453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:25.129374 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:25.138002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24949bf8-bdf6-4b3e-90e5-5bdf62c62105 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1371 microversion: 2.1 time: 0.226676 Sep 09 12:09:25.138684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 232/487] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:24 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:26.162521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:26.163127 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:26.169876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:26.170381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:26.170810 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:26.171564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:26.172035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:26.172450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:26.324353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:09:26.333675 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eee024c6-c171-472f-baaf-306e5fde1d98 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1565 microversion: 2.1 time: 0.174941 Sep 09 12:09:26.334280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 256/488] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:09:26 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:09:26.357419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:09:26.358053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:09:26.364344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:26.364743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:26.365188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:26.365883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:26.366391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:26.366827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:26.447293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3050138b-bdf6-49ca-8ec7-2ad1eee92322 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094049 Sep 09 12:09:26.447961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 233/489] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:09:26 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:09:27.502748 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-3ae6a27b-707d-4492-94f0-1c3632f69e04 req-6cbf324a-b55e-40dd-aa2c-8114b08db10a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072fca7e-cc8f-41e9-9244-26d624d71486", "tag": "7a8a023e-5606-4a22-825d-2444697c029b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:09:27.512879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3ae6a27b-707d-4492-94f0-1c3632f69e04 req-6cbf324a-b55e-40dd-aa2c-8114b08db10a service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:09:27.513344 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3ae6a27b-707d-4492-94f0-1c3632f69e04 req-6cbf324a-b55e-40dd-aa2c-8114b08db10a service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:09:27.513784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-3ae6a27b-707d-4492-94f0-1c3632f69e04 req-6cbf324a-b55e-40dd-aa2c-8114b08db10a service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:09:27.525549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-3ae6a27b-707d-4492-94f0-1c3632f69e04 req-6cbf324a-b55e-40dd-aa2c-8114b08db10a service nova] Creating event network-changed:7a8a023e-5606-4a22-825d-2444697c029b for instance 072fca7e-cc8f-41e9-9244-26d624d71486 on hv-cinder-85221 Sep 09 12:09:27.531109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-3ae6a27b-707d-4492-94f0-1c3632f69e04 req-6cbf324a-b55e-40dd-aa2c-8114b08db10a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031821 Sep 09 12:09:27.535615 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 257/490] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:18.456257 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=13 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:18.457039 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=77 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:18.458520 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:10:18.458718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:10:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/ips (ip 10.222.0.62) !!! Sep 09 12:10:18.470656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:18.471078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:18.478723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:18.479213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:18.479655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:18.480353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:18.480815 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:18.481251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:18.508085 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1e1f460d-63b8-46b5-809d-202b45bec36a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/ips" status: 200 len: 144 microversion: 2.1 time: 0.053394 Sep 09 12:10:18.508683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 234/491] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:10:18 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/ips => generated 144 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:19.912090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:19.912832 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=51 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:19.914282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:10:19.914444 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Fri Sep 9 12:10:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/ips (ip 10.222.0.62) !!! Sep 09 12:10:19.920026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:19.920604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:19.928962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:19.929445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:19.929883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:19.930614 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:19.931067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:19.931489 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:19.956800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0df78168-4c11-423e-8d28-b726b4455e38 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/ips" status: 200 len: 149 microversion: 2.1 time: 0.045715 Sep 09 12:10:19.965061 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 258/492] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:10:19 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:21.346351 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca57d24b-139b-4cf1-992d-6fa6a1d7b58d"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:21.348754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:21.355061 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:21.355538 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:21.355972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:21.356651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:21.357097 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:21.357620 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:21.636416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4908fc54-0c8d-4618-9684-100943013e4e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294061 Sep 09 12:10:21.637547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 235/493] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:10:21 2022] POST /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:23.147571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2169ba3-d0b9-41a3-a3c2-710d16cce897"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:23.149911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:23.156134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:23.156611 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:23.157057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:23.157730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:23.158219 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:23.158642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:23.470017 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-211bf544-d70b-44e9-b6aa-b1fe7f23edc1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326974 Sep 09 12:10:23.470656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 259/494] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:10:23 2022] POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:27.529530 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:27.530144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:27.536685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:27.537163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:27.537593 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:27.538393 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:27.538846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:27.539265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:27.563951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d459fff-1476-4bcf-aabd-deb8ce440e42 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/ips" status: 200 len: 153 microversion: 2.20 time: 0.039220 Sep 09 12:10:27.564527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 236/495] 10.222.0.62 () {60 vars in 1289 bytes} [Fri Sep 9 12:10:27 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:10:29.189871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bd5ac3b-aa46-47cf-8c78-02ff9a07be19 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: .version_select at 0x7ff2d93eeaf0>, body: {"keypair": {"name": "tempest-keypair-191558161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf4NDcGv7AsWVHBQNfbJ3pgWvgid4wzYfHSZUnFEa0DtNBoTo6BLcWik7xsKhO+LZHfvKuRfghEq5HlXbJs16kIeaVJgZv227UNVNb1neTmFclxK7oKdMO1yTLl9C/y8w=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:29.211180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-6bd5ac3b-aa46-47cf-8c78-02ff9a07be19 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:10:29.217894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-6bd5ac3b-aa46-47cf-8c78-02ff9a07be19 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:10:29.244635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bd5ac3b-aa46-47cf-8c78-02ff9a07be19 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059407 Sep 09 12:10:29.245503 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 260/496] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:10:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:29.346055 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:29.346729 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:29.353994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:29.354665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:29.355251 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:29.356140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:29.357161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:29.357595 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:29.382662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lazy-loading 'flavor' on Instance uuid 214a4341-91a9-4b8e-b1db-4e07620cfbf7 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:10:29.633829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-51d83e6c-a9ab-4d0f-b6d0-fc2af28a9b79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/action" status: 202 len: 0 microversion: 2.20 time: 0.291567 Sep 09 12:10:29.634549 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 237/497] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 9 12:10:29 2022] POST /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:10:29.643874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:29.644820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:29.652174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:29.652529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:29.652963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:29.654287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:29.654747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:29.655309 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:29.790518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:29.798975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:29.800419 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:29.801587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bd49a1e5-14f5-436f-b062-eeb16207ecea tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.162564 Sep 09 12:10:29.802186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 261/498] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:29 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:30.586724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-4918300", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846b424-a53d-4e1e-9d8f-617b0d2b2566"}], "security_groups": [{"name": "tempest-securitygroup--286139874"}], "key_name": "tempest-keypair-191558161", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:30.697892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] validate_networks() for [('f846b424-a53d-4e1e-9d8f-617b0d2b2566', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:10:30.827293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:30.827895 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:30.834592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:30.835070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:30.835498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:30.836192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:30.836642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:30.837060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:30.972746 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:30.980820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:30.982929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:30.984080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-751c8908-13fc-4d0a-bb4d-0439dac32af4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.160688 Sep 09 12:10:30.984629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 262/499] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:30 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:10:31.071476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:10:31.071894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:10:31.072359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:10:31.072759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:10:31.073165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:10:31.082790 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:31.083262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:31.083689 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:31.084399 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:31.084847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:31.085265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:31.101782 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:10:31.105653 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:10:31.117061 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:10:31.119449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:10:31.168332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3ea65946-4985-4344-b015-d6fbdeadfa0f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.587189 Sep 09 12:10:31.169010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 238/500] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:10:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:10:31.180067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1ac7ea0-82e6-4838-aab9-8c63a068179d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:31.180711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1ac7ea0-82e6-4838-aab9-8c63a068179d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:31.240722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1ac7ea0-82e6-4838-aab9-8c63a068179d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:31.248862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1ac7ea0-82e6-4838-aab9-8c63a068179d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1238 microversion: 2.1 time: 0.072535 Sep 09 12:10:31.249511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 263/501] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:31 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:32.011692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:32.011692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:32.018206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:32.018773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:32.019286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:32.020057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:32.020609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:32.021108 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:32.156639 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:32.164820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:32.166301 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:32.167458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-07773915-591a-4c01-b971-2be3109441cc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.162174 Sep 09 12:10:32.168017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 239/502] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:32 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:32.270904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:32.271517 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:32.279406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:32.279893 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:32.280330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:32.281027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:32.282058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:32.282569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:32.344549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:32.352160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e2ec502-6c4d-4ceb-98f3-f16e1febc750 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1290 microversion: 2.1 time: 0.085052 Sep 09 12:10:32.352735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 264/503] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:32 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:33.192690 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:33.194036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:33.201826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:33.202541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:33.203287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:33.204287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:33.204702 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:33.205400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:33.377593 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:33.378051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:33.384970 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:33.385469 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:33.385915 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:33.386660 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:33.387114 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:33.387592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:33.465000 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:33.479584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:33.482692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:33.490860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa3a4380-86bb-4b58-96bb-2251e9a4c3fd tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.299639 Sep 09 12:10:33.491646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 240/504] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:33 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:33.557493 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:33.565213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8aad1e13-be30-43f2-8ea5-e9b14732f45b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.191866 Sep 09 12:10:33.565784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 265/505] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:33 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:34.003165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-8c730b42-b467-417f-9caf-0269927fb8d4 req-82ced06c-6369-47ad-8a51-82b9e92b647a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a56358-0027-49dc-ba72-8b3d31456c08", "tag": "2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:34.013885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8c730b42-b467-417f-9caf-0269927fb8d4 req-82ced06c-6369-47ad-8a51-82b9e92b647a service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:34.014468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8c730b42-b467-417f-9caf-0269927fb8d4 req-82ced06c-6369-47ad-8a51-82b9e92b647a service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:34.014902 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-8c730b42-b467-417f-9caf-0269927fb8d4 req-82ced06c-6369-47ad-8a51-82b9e92b647a service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:34.027051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-8c730b42-b467-417f-9caf-0269927fb8d4 req-82ced06c-6369-47ad-8a51-82b9e92b647a service nova] Creating event network-changed:2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d for instance d3a56358-0027-49dc-ba72-8b3d31456c08 on hv-cinder-85221 Sep 09 12:10:34.031923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-8c730b42-b467-417f-9caf-0269927fb8d4 req-82ced06c-6369-47ad-8a51-82b9e92b647a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032456 Sep 09 12:10:34.032512 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 241/506] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:10:34.516894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:34.517460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:34.523933 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:34.524436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:34.524868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:34.525562 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:34.526013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:34.526478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:34.597002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:34.597702 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:34.603797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:34.604285 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:34.604727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:34.605557 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:34.606017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:34.606514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:34.663033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:34.671662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:34.673118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:34.674446 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c00efc81-ff78-4095-9719-1e8e5d2a50b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.162046 Sep 09 12:10:34.675004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 266/507] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:34 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:34.743040 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:34.751334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39bc3dbe-86c6-426b-85be-3a870fac1480 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.158944 Sep 09 12:10:34.751950 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 242/508] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:34 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:35.701879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:35.702512 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:35.709101 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:35.709593 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:35.710053 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:35.710773 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:35.711230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:35.711653 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:35.774399 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:35.775017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:35.781639 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:35.782143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:35.782599 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:35.783299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:35.783753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:35.784173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:35.844976 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:35.853830 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:35.855294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:35.856482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dd48a05-98bb-4abe-9a62-e6bebd4cb9f2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.159830 Sep 09 12:10:35.857752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 267/509] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:35 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:35.927629 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:35.935930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afeadad6-fa84-4e66-ac26-ea876f802571 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.164706 Sep 09 12:10:35.936490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 243/510] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:35 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:36.883253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:36.883852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:36.891238 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:36.891724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:36.892151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:36.892836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:36.893279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:36.893688 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:36.958960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:36.959581 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:36.965891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:36.966434 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:36.966873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:36.967572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:36.968034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:36.968463 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:37.025898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:37.034217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:37.035645 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:37.036789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1b698e68-92e7-4abb-b521-f45a896e2814 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.157482 Sep 09 12:10:37.037343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 268/511] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:36 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:10:37.098333 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:37.105892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4af0c112-5d8f-44c1-920c-de6b5b333b08 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.150973 Sep 09 12:10:37.106484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 244/512] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:36 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:38.062605 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:38.063250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:38.070140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:38.070635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:38.071074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:38.071820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:38.072276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:38.072699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:38.129862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:38.130505 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:38.138724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:38.139594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:38.140034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:38.140779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:38.141225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:38.141651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:38.221487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:38.236086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:38.237291 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:38.238534 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-406d16c7-02b7-4e60-aed1-d8ec9954ff5d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.180018 Sep 09 12:10:38.239107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 269/513] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:38 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:38.377940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:38.386088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25e27be2-21b8-4f3f-b0b2-fa421f1b8e94 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.260792 Sep 09 12:10:38.386680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 245/514] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:38 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:39.265428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:39.266030 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:39.273565 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:39.274040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:39.274495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:39.275178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:39.275622 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:39.276035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:39.409491 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:39.409681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:39.410369 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:39.416816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:39.417356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:39.418233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:39.418499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:39.418927 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:39.419753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:39.420187 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:39.420341 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:39.422399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c41d5f9-ebab-42e2-b143-12a06d0ed1c5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.161453 Sep 09 12:10:39.423521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 270/515] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:39 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:39.520294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-add4a6cd-ffcc-4016-8433-5fce235ce0d5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:39.526395 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add4a6cd-ffcc-4016-8433-5fce235ce0d5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:39.526874 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add4a6cd-ffcc-4016-8433-5fce235ce0d5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:39.527302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-add4a6cd-ffcc-4016-8433-5fce235ce0d5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:39.556347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:39.564474 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1211486-57a2-44ca-af59-3c1e7e7e2649 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.159656 Sep 09 12:10:39.565224 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 246/516] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:39 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:39.588338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-add4a6cd-ffcc-4016-8433-5fce235ce0d5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Going to try to stop instance {{(pid=120720) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 12:10:39.632957 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-add4a6cd-ffcc-4016-8433-5fce235ce0d5 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action" status: 202 len: 0 microversion: 2.1 time: 0.116316 Sep 09 12:10:39.633698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 271/517] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:10:39 2022] POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:10:39.642808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:39.643543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:39.649350 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:39.649886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:39.650515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:39.651449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:39.652084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:39.652581 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:39.786331 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:39.795222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1a851fca-62c0-45bd-806f-f09366148c19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.157096 Sep 09 12:10:39.795766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 247/518] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:39 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:40.449302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:40.449995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:40.456670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:40.457153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:40.457592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:40.458313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:40.458772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:40.459203 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:40.587185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:40.588533 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:40.590951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:40.596763 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:40.597356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:40.597870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:40.598673 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:40.599370 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:40.599872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:40.600120 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:40.601753 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:40.602945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1b25536-5071-44a0-b50d-cab15c3359bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.158425 Sep 09 12:10:40.603688 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 272/519] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:40 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:40.737515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:40.745586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0b5ef91-9e9f-45be-a615-3c273ac72840 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.162001 Sep 09 12:10:40.746292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 248/520] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:40 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:40.762404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8f7bcb34-a99f-49e6-b517-b54aee34a28c req-16ecfa52-a60b-4324-bcc6-63a15905abc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56358-0027-49dc-ba72-8b3d31456c08", "name": "network-vif-plugged", "status": "completed", "tag": "2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:40.773251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f7bcb34-a99f-49e6-b517-b54aee34a28c req-16ecfa52-a60b-4324-bcc6-63a15905abc5 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:40.773726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f7bcb34-a99f-49e6-b517-b54aee34a28c req-16ecfa52-a60b-4324-bcc6-63a15905abc5 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:40.774170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f7bcb34-a99f-49e6-b517-b54aee34a28c req-16ecfa52-a60b-4324-bcc6-63a15905abc5 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:40.785089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8f7bcb34-a99f-49e6-b517-b54aee34a28c req-16ecfa52-a60b-4324-bcc6-63a15905abc5 service nova] Creating event network-vif-plugged:2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d for instance d3a56358-0027-49dc-ba72-8b3d31456c08 on hv-cinder-85221 Sep 09 12:10:40.789885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8f7bcb34-a99f-49e6-b517-b54aee34a28c req-16ecfa52-a60b-4324-bcc6-63a15905abc5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034086 Sep 09 12:10:40.790592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 273/521] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:40.819175 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:40.819793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:40.826340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:40.826829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:40.827269 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:40.827963 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:40.828423 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:40.828851 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:40.833030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:40.961241 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:40.970511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f092130-8fb1-44b0-a4da-2038af284dea tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.155284 Sep 09 12:10:40.971091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 249/522] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:40 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:41.625686 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:41.630570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:41.631288 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:41.638047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:41.638593 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:41.639003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:41.639693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:41.640151 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:41.640581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:41.770451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:41.771079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:41.772912 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:41.773570 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:41.779102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:41.781308 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:41.781798 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:41.782279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:41.782985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:41.783619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:41.784046 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:41.787576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:41.789011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:41.790199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-64d13fac-149e-4837-bee3-5f14ec305ab8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.165516 Sep 09 12:10:41.790755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 274/523] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:41 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:41.929669 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:41.937375 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-528c3127-1896-42b3-ba37-a1afd521c130 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.170924 Sep 09 12:10:41.937939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 250/524] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:41 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:41.993207 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:41.993813 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:42.000126 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:42.000618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:42.001060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:42.001759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:42.002306 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:42.002677 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:42.006754 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:42.132673 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:42.141374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5d9d093-a397-45c0-859b-4f243733960a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.151954 Sep 09 12:10:42.141930 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 275/525] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:41 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:42.814895 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:42.815577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:42.823041 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:42.823565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:42.824154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:42.825043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:42.826185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:42.826781 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:42.959422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:42.960262 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:42.960883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:42.967353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:42.967721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:42.967853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:42.968267 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:42.968963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:42.969143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:42.969419 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:42.969843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:42.970318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-074a245d-98ee-4adb-af8c-418879c9bd79 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1745 microversion: 2.20 time: 0.159437 Sep 09 12:10:42.970877 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 251/526] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:42 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:43.110407 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:43.118145 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-24c008f4-7bf0-409b-ac52-683f3fa675da tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1363 microversion: 2.1 time: 0.161690 Sep 09 12:10:43.118729 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 276/527] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:42 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:43.164020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:43.164640 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:43.170903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:43.171398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:43.171838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:43.172540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:43.172992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:43.173416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:43.306531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:43.315344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0861da37-0d7b-4311-b8d7-86444385fc32 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.155206 Sep 09 12:10:43.315906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 252/528] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:43 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:43.996937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:43.998102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:44.008762 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.009247 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.009688 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.010679 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.011285 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.011732 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.141350 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:44.141968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:44.146616 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:44.148492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.148976 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.149411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.150107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.150591 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.151012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.155621 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:44.157073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:44.158331 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d7a75c5-9afc-4e08-911b-b7ecad0b1e46 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1745 microversion: 2.20 time: 0.165645 Sep 09 12:10:44.159030 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 277/529] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:43 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:44.288416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:44.296930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cfbf2a02-1384-4dea-bc25-f8fdfac5b167 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1552 microversion: 2.1 time: 0.159539 Sep 09 12:10:44.297510 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 253/530] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:44 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:44.318815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:44.319311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:44.325225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.325701 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.326161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.326835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.327290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.327720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.339210 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:44.339969 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:44.346870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.347363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.347802 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.348498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.348959 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.349388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.404588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f097266a-9b9e-4165-9a84-18ad90441c55 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089551 Sep 09 12:10:44.405183 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 278/531] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:10:44 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:44.480191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:44.488380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-451dbb64-9f69-405c-971d-55917e85ee81 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.153111 Sep 09 12:10:44.488949 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 254/532] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:44 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:10:44.789987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-b72cadd2-fbc4-4394-b966-2e5542073d01 req-c79e8ea0-3fe4-4acd-b212-a14fae9e58dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214a4341-91a9-4b8e-b1db-4e07620cfbf7", "name": "network-vif-plugged", "status": "completed", "tag": "5d843f0d-cb60-459b-ab64-c48fbc48049a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:44.800872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b72cadd2-fbc4-4394-b966-2e5542073d01 req-c79e8ea0-3fe4-4acd-b212-a14fae9e58dc service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:44.801453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b72cadd2-fbc4-4394-b966-2e5542073d01 req-c79e8ea0-3fe4-4acd-b212-a14fae9e58dc service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:44.801954 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-b72cadd2-fbc4-4394-b966-2e5542073d01 req-c79e8ea0-3fe4-4acd-b212-a14fae9e58dc service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:44.819876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-b72cadd2-fbc4-4394-b966-2e5542073d01 req-c79e8ea0-3fe4-4acd-b212-a14fae9e58dc service nova] Creating event network-vif-plugged:5d843f0d-cb60-459b-ab64-c48fbc48049a for instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 on hv-cinder-85221 Sep 09 12:10:44.824713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-b72cadd2-fbc4-4394-b966-2e5542073d01 req-c79e8ea0-3fe4-4acd-b212-a14fae9e58dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038704 Sep 09 12:10:44.826212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 279/533] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:45.183998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:45.184686 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:45.191882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:45.192606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:45.193047 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:45.193754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:45.194238 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:45.194668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:45.334402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:45.342694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:45.344154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:45.345335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-71167d1e-81fe-4d68-8c32-e398ce8e3053 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1745 microversion: 2.20 time: 0.165261 Sep 09 12:10:45.345899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 255/534] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:45 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:45.369597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-13520b7c-1327-4227-8110-7979b0c36a05 req-732944f5-d9a5-4e3f-87bd-2b5587ee560e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a56358-0027-49dc-ba72-8b3d31456c08", "tag": "2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:10:45.379834 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-13520b7c-1327-4227-8110-7979b0c36a05 req-732944f5-d9a5-4e3f-87bd-2b5587ee560e service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:45.380304 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-13520b7c-1327-4227-8110-7979b0c36a05 req-732944f5-d9a5-4e3f-87bd-2b5587ee560e service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:45.380737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-13520b7c-1327-4227-8110-7979b0c36a05 req-732944f5-d9a5-4e3f-87bd-2b5587ee560e service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:45.391900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-13520b7c-1327-4227-8110-7979b0c36a05 req-732944f5-d9a5-4e3f-87bd-2b5587ee560e service nova] Creating event network-changed:2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d for instance d3a56358-0027-49dc-ba72-8b3d31456c08 on hv-cinder-85221 Sep 09 12:10:45.396941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-13520b7c-1327-4227-8110-7979b0c36a05 req-732944f5-d9a5-4e3f-87bd-2b5587ee560e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031730 Sep 09 12:10:45.397612 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 280/535] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:10:45.512667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:45.513290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:45.519589 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:45.520207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:45.520660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:45.521366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:45.522015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:45.522466 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:45.738424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:45.747546 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ee18202c-6d8b-40c7-8dae-b3f15cf6f60d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.238944 Sep 09 12:10:45.748407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 256/536] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:45 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:46.375563 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:46.376270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:46.382564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:46.383048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:46.383485 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:46.384175 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:46.384620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:46.385035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:46.514836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:46.523170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:46.524584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:46.525730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d65f47e3-80e5-4702-b83d-3033ac6b8b8a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1745 microversion: 2.20 time: 0.157225 Sep 09 12:10:46.526490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 281/537] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:46 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:46.771059 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:46.771669 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:46.777970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:46.778524 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:46.778964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:46.779652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:46.780112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:46.780540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:46.912493 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:46.920617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c91a1468-8df0-42f8-8548-1cf32032e330 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.153452 Sep 09 12:10:46.921175 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 257/538] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:46 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:47.551252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:47.551798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:47.558354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:47.558921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:47.559274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:47.560589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:47.561042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:47.561470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:47.692180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:47.700740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:47.702213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:47.703373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdd94188-0981-4ca5-8e44-1d7b74016ff3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1745 microversion: 2.20 time: 0.156111 Sep 09 12:10:47.703937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 282/539] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:47 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:47.944035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:47.944672 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:47.951216 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:47.951710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:47.952149 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:47.952838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:47.953299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:47.953730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:48.081793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:48.089989 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a6a4c96f-f9aa-4de3-ad75-3eae07824537 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.149891 Sep 09 12:10:48.091060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 258/540] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:47 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:48.728642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:48.729282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:48.735816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:48.736296 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:48.736730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:48.737415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:48.737880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:48.738337 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:48.871716 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:48.880410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:48.881795 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:48.883014 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fdbf751a-14c7-4b21-baf7-435faa5572c2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1745 microversion: 2.20 time: 0.158289 Sep 09 12:10:48.883586 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 283/541] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:48 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:49.113293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:49.113901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:49.116232 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:49.121851 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:49.122903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:49.123344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:49.124046 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:49.124509 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:49.124938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:49.271641 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:49.280770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-78f73d1e-ebbd-45eb-a35b-b188bbff21a2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.171329 Sep 09 12:10:49.281332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 259/542] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:49 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:49.914941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:49.916354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:49.924166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:49.924654 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:49.925274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:49.926165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:49.926634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:49.927062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:50.089620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:50.101445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:50.103568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:50.106801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1e51c4f9-ac8c-49a4-a345-af16f332b5ee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.200327 Sep 09 12:10:50.108116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 284/543] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:49 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:50.306444 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:50.307947 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:50.317121 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:50.317608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:50.318245 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:50.318941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:50.319396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:50.319817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:50.474288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:50.484245 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c8dd694-0eb2-4e3c-ba69-b2607f2063f2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.183055 Sep 09 12:10:50.494681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 260/544] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:50 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:51.136363 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:51.136976 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:51.143100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:51.173356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:51.174163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:51.174600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:51.175292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:51.175906 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:51.176487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:51.332164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:51.342198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:51.343657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:51.344829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d674a03-1420-4b59-bc9e-84bf78e12281 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.213061 Sep 09 12:10:51.357089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 285/545] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:51 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:51.510681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:51.512043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:51.522506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:51.523182 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:51.523621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:51.524325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:51.524782 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:51.525207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:51.696010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:51.705388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f50bf788-ee09-415c-9246-9f5cac771549 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.199916 Sep 09 12:10:51.706457 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 261/546] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:51 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:52.370823 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:52.371560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:52.379017 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:52.379608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:52.380118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:52.380911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:52.381385 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:52.381808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:52.543145 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:52.555168 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:52.556857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:52.558024 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0df09d3a-5c8f-4414-80d0-91f3b5a5df1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.191546 Sep 09 12:10:52.558615 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 286/547] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:52 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:52.733895 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:52.734614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:52.741150 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:52.741673 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:52.742139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:52.742843 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:52.743304 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:52.743734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:52.887775 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:52.901167 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43069d78-ee3c-4f7a-ab7e-46d15e2075f7 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.173060 Sep 09 12:10:52.917011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 262/548] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:52 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:53.587284 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:53.588334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:53.596855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:53.597692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:53.598497 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:53.599457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:53.600060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:53.600868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:53.756356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:53.765432 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:53.766927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:53.768094 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d87da88c-91a1-4339-a41a-a6705862acda tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.186593 Sep 09 12:10:53.768847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 287/549] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:53 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:53.925546 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:53.926065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:53.933915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:53.934606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:53.935123 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:53.935942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:53.936404 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:53.936868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:54.084752 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:54.096274 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-19e666bc-25a8-4ccc-98e5-c27296b2f4c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.174583 Sep 09 12:10:54.096855 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 263/550] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:53 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:54.792942 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:54.793597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:54.800440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:54.800922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:54.801350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:54.802043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:54.802515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:54.802934 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:54.939923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:54.951770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:54.953255 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:54.954536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff3b7a3b-d14c-4452-99dd-5a3f34d6226d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.165493 Sep 09 12:10:54.955130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 288/551] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:54 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:55.125078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:55.125078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:55.134715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:55.135209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:55.135669 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:55.136460 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:55.136873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:55.137320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:55.302470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:55.313170 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ad00dddc-b3c2-4619-b1c2-a0cc2acee613 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.194682 Sep 09 12:10:55.313802 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 264/552] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:55 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:55.981016 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:55.981633 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:55.990487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:55.991262 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:55.991867 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:55.992566 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:55.993026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:55.993496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:56.156913 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:56.174198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:56.175726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:56.176908 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9b111dc-c51d-453f-a87d-a19a9e21a975 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.200153 Sep 09 12:10:56.177527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 289/553] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:55 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:56.338382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:56.339627 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:56.347301 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:56.348154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:56.348849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:56.350361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:56.351320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:56.352320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:56.508609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:56.513795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:10:56.522931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bddca213-e210-4422-b90f-11ff4c7433c1 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.189253 Sep 09 12:10:56.523821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 265/554] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:56 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:57.208822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:57.209480 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:57.216946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:57.217844 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:57.219334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:57.222189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:57.222189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:57.222189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:57.397764 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:57.407260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:57.408759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:57.409939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-455190c0-b54d-4224-98e0-23580da1fe89 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.205188 Sep 09 12:10:57.414158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 290/555] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:57 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:57.548370 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:57.548950 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:57.555981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:57.556473 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:57.556908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:57.557638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:57.558095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:57.558554 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:57.713191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:57.726414 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-20a2a2a9-16d5-4b7d-93ed-8bcaaed0a673 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.182383 Sep 09 12:10:57.727015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 266/556] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:57 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:58.436677 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:58.437282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:58.443690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:58.444170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:58.444602 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:58.445285 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:58.445766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:58.446334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:58.576033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:58.584159 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:58.585639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:58.586821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2181173c-de0d-4b70-8b86-cb83310649f3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1740 microversion: 2.20 time: 0.154049 Sep 09 12:10:58.587380 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 291/557] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:58 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:58.752012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:58.752543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:58.759010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:58.759496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:58.759935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:58.760632 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:58.761089 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:58.761526 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:58.890147 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:58.898359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dbf63fd6-c2ff-4f72-aecb-44feed7bb6d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.150272 Sep 09 12:10:58.898938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 267/558] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:58 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:10:59.617463 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:59.618062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:59.628565 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:59.629049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:59.629482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:59.630198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:59.630646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:59.631065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:59.766179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:59.774570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:59.776133 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:10:59.777529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8d4126d1-eef7-41e9-9812-e812ba5edf2a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1722 microversion: 2.20 time: 0.165515 Sep 09 12:10:59.778794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 292/559] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:10:59 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:10:59.923005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:10:59.923651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:10:59.930160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:59.930660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:59.931105 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:10:59.931925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:10:59.932452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:10:59.932882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:00.085659 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:00.093917 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d0a999d0-3f5a-4b30-af3c-913b97ac7a8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1722 microversion: 2.1 time: 0.174772 Sep 09 12:11:00.094519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 268/560] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:10:59 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:00.804018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:00.804636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:00.811025 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:00.811513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:00.811945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:00.812626 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:00.813078 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:00.813504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:00.832959 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:00.944569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:00.953118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:00.954582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:00.955740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3715d109-f46b-44dc-9e1d-83b2c6f4e299 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1722 microversion: 2.20 time: 0.155779 Sep 09 12:11:00.956291 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 293/561] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:00 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:01.116737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:01.117342 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:01.124003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:01.124487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:01.124923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:01.125638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:01.126134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:01.126559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:01.256287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:01.264786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22f767bd-e66a-4155-b4ca-c2cd1028a432 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1699 microversion: 2.1 time: 0.151894 Sep 09 12:11:01.265357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 269/562] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:01 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:11:01.287379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1dc886d-cfe3-45b9-b44a-4978b315aedb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:01.294019 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc886d-cfe3-45b9-b44a-4978b315aedb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:01.294549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc886d-cfe3-45b9-b44a-4978b315aedb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:01.295007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1dc886d-cfe3-45b9-b44a-4978b315aedb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:01.319328 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1dc886d-cfe3-45b9-b44a-4978b315aedb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Going to try to start instance {{(pid=120720) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 12:11:01.359691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1dc886d-cfe3-45b9-b44a-4978b315aedb tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action" status: 202 len: 0 microversion: 2.1 time: 0.076037 Sep 09 12:11:01.360307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 294/563] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:11:01 2022] POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:11:01.368389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:01.368998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:01.375390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:01.375877 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:01.376314 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:01.377008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:01.377465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:01.377889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:01.504771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:01.513033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d2c24296-4acb-4ecf-9bac-ece6a3127a98 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1708 microversion: 2.1 time: 0.148427 Sep 09 12:11:01.513594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 270/564] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:01 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:01.982537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:01.983233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:01.989476 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:01.989955 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:01.990415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:01.991104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:01.991554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:01.991976 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:02.132493 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:02.141468 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:02.142949 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:02.144111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08714a79-f925-4fdb-8eed-afd3b4276f25 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1722 microversion: 2.20 time: 0.166917 Sep 09 12:11:02.144898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 295/565] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:01 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:02.536777 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:02.537322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:02.544412 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:02.544893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:02.545332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:02.546049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:02.546580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:02.547015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:02.681418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:02.690683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22ffeb2c-3d8d-4726-8d8d-907ef05efb49 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1708 microversion: 2.1 time: 0.157796 Sep 09 12:11:02.691897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 271/566] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:02 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:02.843003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-55a63d13-e07c-4d62-a543-994fedd27d78 req-4750a696-33da-4581-a09a-97e21fbfe120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214a4341-91a9-4b8e-b1db-4e07620cfbf7", "name": "network-vif-unplugged", "status": "completed", "tag": "5d843f0d-cb60-459b-ab64-c48fbc48049a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:02.852824 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55a63d13-e07c-4d62-a543-994fedd27d78 req-4750a696-33da-4581-a09a-97e21fbfe120 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:02.853372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55a63d13-e07c-4d62-a543-994fedd27d78 req-4750a696-33da-4581-a09a-97e21fbfe120 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:02.853878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-55a63d13-e07c-4d62-a543-994fedd27d78 req-4750a696-33da-4581-a09a-97e21fbfe120 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:02.867069 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.compute.server_external_events [req-55a63d13-e07c-4d62-a543-994fedd27d78 req-4750a696-33da-4581-a09a-97e21fbfe120 service nova] Unable to find a host for instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7. Dropping event network-vif-unplugged {{(pid=120720) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 12:11:02.867947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-55a63d13-e07c-4d62-a543-994fedd27d78 req-4750a696-33da-4581-a09a-97e21fbfe120 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029440 Sep 09 12:11:02.868536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 296/567] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 12:11:03.169786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:03.170577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:03.176560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.177037 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.177466 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.178173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.178639 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.179062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.310268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:03.318410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:03.319841 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:03.320982 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95fbe733-1400-4d34-b8cd-15b3477a81a8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1665 microversion: 2.20 time: 0.155689 Sep 09 12:11:03.321546 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 272/568] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:03 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:03.345404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9a18af5-3470-49c6-8bca-f4bd29a8759a"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:03.347800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:03.354441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.354927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.355415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.356618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.357070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.357494 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.640747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1bdefa81-b5e8-451e-9a1c-453995702120 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299532 Sep 09 12:11:03.641385 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 297/569] 10.222.0.62 () {62 vars in 1364 bytes} [Fri Sep 9 12:11:03 2022] POST /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:11:03.714094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:03.714760 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:03.721603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.722084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.722737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.723434 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.723891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.724318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.768652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:03.769233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:03.776410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.776920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.777355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.778791 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.779246 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.779673 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.824293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120720) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 12:11:03.861445 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:03.869604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae11273c-84a8-425c-8d9c-be58c1b8d8bc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1708 microversion: 2.1 time: 0.159233 Sep 09 12:11:03.870472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 273/570] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:03 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:03.906008 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5ef6c516-8423-4012-9fbb-13eaeec6c503 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/action" status: 202 len: 0 microversion: 2.20 time: 0.141215 Sep 09 12:11:03.906888 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 298/571] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 9 12:11:03 2022] POST /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 09 12:11:03.916388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:03.916995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:03.923407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.923883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.924313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:03.924999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:03.925447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:03.925916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:04.058249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:04.067004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:04.068455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:04.069942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-110cb7d7-7a7a-4fe4-b91b-1f409af64c7a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1751 microversion: 2.20 time: 0.157295 Sep 09 12:11:04.070287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 274/572] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:03 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:04.895035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:04.895656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:04.903210 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:04.903713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:04.904152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:04.904853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:04.905311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:04.905739 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:05.043348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:05.052505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5fc3c00d-c916-4584-9fbb-208422772e24 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1712 microversion: 2.1 time: 0.161908 Sep 09 12:11:05.053083 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 299/573] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:04 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1712 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:05.095598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:05.096272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:05.102901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:05.103386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:05.103819 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:05.104502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:05.104936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:05.105363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:05.242413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:05.252434 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:05.253863 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:05.255050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-359e65b5-fde8-4ee0-b581-1cf805e9022a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1753 microversion: 2.20 time: 0.163440 Sep 09 12:11:05.255609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 275/574] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:05 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:06.282413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:06.283449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:06.290712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:06.291208 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:06.291646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:06.292355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:06.292814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:06.293307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:06.424297 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:06.433114 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:06.434609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:06.435786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5e0b2604-98d4-4f17-8e96-61c57d7e02e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.158389 Sep 09 12:11:06.436330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 300/575] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:06 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:07.460709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:07.461385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:07.468850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:07.469283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:07.469746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:07.470567 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:07.470937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:07.471743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:07.608409 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:07.617668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:07.619123 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:07.621738 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ebaba732-43f5-4b4b-8b5f-a105356bd04e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.163943 Sep 09 12:11:07.634869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 276/576] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:07 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:08.648984 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:08.649668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:08.657572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:08.658060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:08.658603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:08.659304 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:08.659758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:08.660179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:08.847330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:08.857650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:08.859196 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:08.860440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ed6959ee-a4de-4615-8e90-cbadde3dde47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.215333 Sep 09 12:11:08.861073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 301/577] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:08 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:09.886151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:09.886758 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:09.893904 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:09.894423 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:09.894864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:09.895565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:09.896024 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:09.896452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:10.329710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:10.339820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:10.342168 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:10.343373 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f874ab1-98f8-44de-958b-d6dd79942f94 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.461186 Sep 09 12:11:10.343962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 277/578] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:09 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:11.373199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:11.373811 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:11.380384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:11.380958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:11.381445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:11.382227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:11.382766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:11.383190 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:11.528987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:11.537956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:11.539424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:11.540592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5404060-04eb-4192-b1dd-7ab5d92aa3c6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.172665 Sep 09 12:11:11.541367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 302/579] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:11 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:12.566269 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:12.566878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:12.573400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:12.573892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:12.574381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:12.575683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:12.576140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:12.576651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:12.717751 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:12.727186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:12.728616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:12.729785 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-08c9997a-cd70-4191-b61f-dbe0949f8163 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.167502 Sep 09 12:11:12.730525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 278/580] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:12 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:13.579582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "223eb73f-9738-4f86-ba03-6370b39272c9"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:13.581893 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:13.588798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:13.589292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:13.589730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:13.591033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:13.591493 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:13.591921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:13.756112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:13.756828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:13.763665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:13.764154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:13.764599 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:13.765299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:13.765759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:13.766225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:13.910400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:13.920884 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:13.922616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:13.924009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa40eb1c-b7d2-4479-8b67-83aed357ad19 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.171664 Sep 09 12:11:13.924887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 279/581] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:13 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:14.949771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:14.950580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:14.957556 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:14.958041 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:14.958552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:14.959276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:14.959744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:14.960165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:15.094530 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:15.103308 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:15.104808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:15.105982 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea28dd30-cb61-4628-94e5-1cd9868a8a92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.160143 Sep 09 12:11:15.106578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 280/582] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:14 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:16.132622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:16.133294 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:16.140769 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:16.141366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:16.141884 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:16.142680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:16.143227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:16.143959 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:16.302693 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:16.311588 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:16.313101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:16.314319 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c49d31ac-5212-4874-8a9c-6c234e6511b2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.185625 Sep 09 12:11:16.314873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 281/583] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:16 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:17.340864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:17.341536 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:17.348873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:17.349366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:17.349804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:17.350559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:17.351022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:17.351453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:17.372541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:17.484787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:17.493880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:17.495800 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:17.497094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6fa2cb2a-6985-4449-8a70-0ff34e27a5e1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.160501 Sep 09 12:11:17.497741 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 282/584] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:17 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:18.522836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:18.523475 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:18.530140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:18.530623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:18.531081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:18.531762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:18.532207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:18.532622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:18.661117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:18.669606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:18.671682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:18.672834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5ae6070a-e8ec-4917-b49a-e308af0173c3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.154079 Sep 09 12:11:18.673378 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 283/585] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:18 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:19.698291 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:19.699134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:19.701427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=50 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:19.707656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:19.708214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:19.708654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:19.709345 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:19.709800 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:19.710253 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:19.841793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:19.851035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:19.852466 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:19.853622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea4edb3e-5c34-43cf-afc0-aab6fb37e767 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.159841 Sep 09 12:11:19.854204 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 284/586] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:19 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:20.879786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:20.880436 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:20.887136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:20.887620 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:20.888060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:20.888763 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:20.889778 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:20.890242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:21.017352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:21.025866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:21.027335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:21.028503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-491d108a-d006-4c5a-92e2-00c43709b7c8 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.152718 Sep 09 12:11:21.029072 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 285/587] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:20 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:22.054320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:22.055056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:22.064071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:22.064071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:22.064071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:22.064596 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:22.065060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:22.065482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:22.197065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:22.206245 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:22.207689 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:22.208886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ca34e129-b1f7-4c8d-bcdf-9280d89f06f5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.158466 Sep 09 12:11:22.209439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 286/588] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:22 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:23.240339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:23.242835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:23.255200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:23.256130 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:23.256952 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:23.258252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:23.259069 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:23.259870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:23.438167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f20115e9-8314-4cad-8adc-4aaca0af6fbe tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.861904 Sep 09 12:11:23.444037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 303/589] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:11:13 2022] POST /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments => generated 194 bytes in 9864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:11:23.486282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:23.495525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:23.496980 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:23.498298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fa97371c-8479-4dfa-8c84-dc2098e1f938 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.267431 Sep 09 12:11:23.499219 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 287/590] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:23 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:11:24.524743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:24.525554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:24.529543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:24.536182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:24.536678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:24.537298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:24.538211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:24.539173 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:24.539763 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:24.678482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:24.682035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=8,nova_cell1:INSERT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:24.688265 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:24.689699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:24.690910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf467896-48b0-4035-a83a-bfdbe0449f71 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.170689 Sep 09 12:11:24.691615 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 304/591] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:24 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:25.716501 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:25.717170 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:25.724039 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:25.724535 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:25.725034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:25.726012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:25.726507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:25.726940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:25.857705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:25.866739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:25.868172 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:25.869315 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0643fa7d-18bb-469c-89ba-fde420af0baf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.156767 Sep 09 12:11:25.870613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 288/592] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:25 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:26.896067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:26.896625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:26.904922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:26.905508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:26.906026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:26.906764 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:26.907223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:26.907662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:27.050933 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:27.059901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:27.061351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:27.063161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-930fb98e-97a1-4e22-86a7-9a263dd94577 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.170459 Sep 09 12:11:27.063737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 305/593] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:26 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:28.088490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:28.089158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:28.096743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:28.097451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:28.098008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:28.098750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:28.099310 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:28.099931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:28.235773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:28.244693 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:28.246525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:28.247793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8ec22b02-7dac-4399-9ad0-471fdff7bed2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.163236 Sep 09 12:11:28.248456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 289/594] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:28 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:29.376137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:29.376741 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:29.382914 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:29.383408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:29.383854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:29.384555 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:29.385010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:29.385436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:29.513996 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:29.523165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:29.524610 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:29.525829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b220ca1-201e-48fc-8ba3-61b249dbd95a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.256861 Sep 09 12:11:29.526364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 306/595] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:29 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:30.551596 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:30.552228 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:30.558640 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:30.559126 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:30.559553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:30.560233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:30.560682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:30.561108 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:30.693499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:30.703408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:30.704827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:30.705967 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-913c714a-de2e-43f4-9e44-ce32ded4cad2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.158240 Sep 09 12:11:30.706562 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 290/596] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:30 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:31.730670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:31.731277 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:31.737722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:31.738180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:31.738620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:31.739303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:31.739757 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:31.740179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:31.871873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:31.880505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:31.881975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:31.883180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7fc92b9f-cd4e-4dc9-a124-c9d5f2c571ec tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.156360 Sep 09 12:11:31.883748 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 307/597] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:31 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:32.046025 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:32.048361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:32.054856 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:32.055339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:32.055774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:32.056462 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:32.056914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:32.057338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:32.082169 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lazy-loading 'flavor' on Instance uuid 072fca7e-cc8f-41e9-9244-26d624d71486 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:11:32.208193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ed6f173a-cf06-47dd-8ff3-c4ded513be2e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/action" status: 200 len: 32 microversion: 2.1 time: 0.166012 Sep 09 12:11:32.208843 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 291/598] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:11:32 2022] POST /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:11:32.220066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:32.220685 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:32.227381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:32.227968 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:32.228533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:32.229984 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:32.230478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:32.230909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:32.360868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:32.369106 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2b80b097-f6e4-42b0-b8b5-ad0ada82b769 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.152979 Sep 09 12:11:32.369668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 308/599] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:32 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:32.909510 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:32.910277 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:32.916613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:32.917097 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:32.917535 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:32.918379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:32.919396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:32.920156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:32.991732 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-75f4ed1c-dd6d-444d-878a-ada066756211 req-6a3568af-b702-4843-b36a-38d65b18b181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214a4341-91a9-4b8e-b1db-4e07620cfbf7", "name": "network-vif-plugged", "status": "completed", "tag": "5d843f0d-cb60-459b-ab64-c48fbc48049a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:33.003898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-75f4ed1c-dd6d-444d-878a-ada066756211 req-6a3568af-b702-4843-b36a-38d65b18b181 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:33.004779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-75f4ed1c-dd6d-444d-878a-ada066756211 req-6a3568af-b702-4843-b36a-38d65b18b181 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:33.005672 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-75f4ed1c-dd6d-444d-878a-ada066756211 req-6a3568af-b702-4843-b36a-38d65b18b181 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:33.019684 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-75f4ed1c-dd6d-444d-878a-ada066756211 req-6a3568af-b702-4843-b36a-38d65b18b181 service nova] Creating event network-vif-plugged:5d843f0d-cb60-459b-ab64-c48fbc48049a for instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 on hv-cinder-85221 Sep 09 12:11:33.025628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-75f4ed1c-dd6d-444d-878a-ada066756211 req-6a3568af-b702-4843-b36a-38d65b18b181 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037463 Sep 09 12:11:33.026603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 309/600] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:11:33.064918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:33.074353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:33.075803 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:33.077524 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c5762eaa-6c62-4518-bcbe-5dfc71631f97 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.171841 Sep 09 12:11:33.088626 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 292/601] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:32 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:33.393482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:33.394230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:33.401013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:33.401496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:33.401929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:33.402638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:33.403085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:33.403504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:33.534406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:33.544955 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b51d194f-9fe2-4aa6-a587-61e5cb6b9f4e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.155626 Sep 09 12:11:33.545688 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 310/602] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:33 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:34.102409 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:34.103023 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:34.109580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:34.110064 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:34.110554 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:34.111244 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:34.111700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:34.112148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:34.244413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:34.253862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:34.255318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:34.256470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e53c1bae-6b03-4430-a521-de68c2451fd6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.158062 Sep 09 12:11:34.257030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 293/603] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:34 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:34.569559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:34.570134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:34.576911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:34.577403 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:34.577846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:34.578589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:34.579039 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:34.579452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:34.713260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:34.721644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dc63f827-5f9b-45ae-92ab-dd6c42ecd7e6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.155992 Sep 09 12:11:34.722234 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 311/604] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:34 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:35.283067 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:35.283678 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:35.290042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:35.290561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:35.290999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:35.291690 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:35.292146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:35.292575 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:35.425352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:35.434825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:35.436311 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:35.437400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccc63995-d75e-49d4-8b8a-1db6b4bfc57c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1809 microversion: 2.20 time: 0.159172 Sep 09 12:11:35.437956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 294/605] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:35 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:35.745903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:35.746570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:35.753305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:35.753788 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:35.754237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:35.754917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:35.755369 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:35.755908 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:35.886407 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:35.895333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-61e7bab9-77f8-4f70-bdab-b8428f85807f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.153573 Sep 09 12:11:35.895912 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 312/606] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:35 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:36.463897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:36.464518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:36.471660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:36.472146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:36.472589 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:36.473278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:36.473737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:36.474195 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:36.606459 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:36.615694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:36.617132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:36.618322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-59f687ee-0b3c-4548-afa3-cf8ee5f006d3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1796 microversion: 2.20 time: 0.158336 Sep 09 12:11:36.618885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 295/607] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:11:36 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1796 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:11:36.919093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:36.919715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:36.926275 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:36.926752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:36.927183 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:36.927858 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:36.928303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:36.928720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:37.061829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:37.073450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-718678d6-c4f4-43cb-b8e0-60f6d3d55f43 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.157760 Sep 09 12:11:37.074508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 313/608] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:36 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:38.097980 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:38.098628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:38.104952 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:38.105427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:38.105859 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:38.106561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:38.107012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:38.107433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:38.245018 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:38.253346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4441426d-87d5-42ec-9bf1-7f0dada73363 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.159699 Sep 09 12:11:38.253918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 296/609] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:38 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:39.276603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:39.277297 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:39.283698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:39.284186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:39.284631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:39.285312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:39.285765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:39.286216 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:39.414815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:39.423518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03fd9e49-e187-4373-9395-92fdb1df5247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.150212 Sep 09 12:11:39.424092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 314/610] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:39 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:40.447433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:40.448042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:40.455235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:40.455721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:40.456160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:40.456862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:40.457321 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:40.457750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:40.461910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:40.590584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:40.598847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f9e9c635-30b9-4b1b-bd73-446c778deb24 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.155336 Sep 09 12:11:40.599414 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 297/611] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:40 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:11:41.622314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:41.622920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:41.630180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:41.630665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:41.631096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:41.631786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:41.632233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:41.632649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:41.762958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:41.772458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ab36920-eb88-4516-9fb8-7249f4178ef2 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.154103 Sep 09 12:11:41.773045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 315/612] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:41 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:42.797852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:42.798460 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:42.805116 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:42.805610 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:42.806046 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:42.806839 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:42.807301 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:42.807725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:42.941668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:42.949303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b916c4f5-763f-48b8-9633-cea875ef096f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.155748 Sep 09 12:11:42.949866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 298/613] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:42 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:43.971960 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:43.972574 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:43.979076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:43.979556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:43.979991 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:43.980682 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:43.981136 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:43.981560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:44.112936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:44.121658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b832c8cb-8e77-48c2-8be6-7558444c81d6 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.153663 Sep 09 12:11:44.122251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 316/614] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:43 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:45.144712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:45.145363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:45.151813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:45.152295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:45.152733 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:45.153418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:45.153878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:45.154332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:45.283198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:45.292022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-efa093be-1cdc-4f89-8691-c0741de15791 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.151159 Sep 09 12:11:45.292591 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 299/615] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:45 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:46.315730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:46.316375 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:46.322978 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:46.323464 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:46.323904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:46.324617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:46.325044 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:46.325470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:46.456795 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:46.464971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-542ad6eb-a48e-44ae-9274-fd0a4ada6eaf tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.153158 Sep 09 12:11:46.465545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 317/616] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:46 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:47.489519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:47.490073 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:47.496715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:47.497185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:47.497614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:47.498331 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:47.498776 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:47.499197 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:47.631771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:47.640937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69c699da-29dd-453f-8884-af171a099f2b tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.155872 Sep 09 12:11:47.642213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 300/617] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:47 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:48.664803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:48.665418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:48.671891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:48.672407 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:48.672837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:48.673523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:48.673975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:48.674431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:48.809935 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:48.818674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7b90f959-9ce6-4d08-98af-8436676c44ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.157704 Sep 09 12:11:48.819250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 318/618] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:48 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:49.842997 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:49.843603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:49.846373 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=34 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:49.851801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:49.852280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:49.852710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:49.853424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:49.853880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:49.854334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:49.982890 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:49.991215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e014317a-9323-469d-9d51-d908cffc9684 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.152148 Sep 09 12:11:49.991811 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 301/619] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:49 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:51.014807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:51.015356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:51.021787 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:51.022317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:51.022758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:51.023449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:51.023904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:51.024331 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:51.152445 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:51.161199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c6e1b8ad-98e9-42f8-88ef-37ed37551895 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1735 microversion: 2.1 time: 0.150391 Sep 09 12:11:51.161767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 319/620] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:51 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:52.185833 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:52.186454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:52.192408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.192891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.193329 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.194029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.194620 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.195053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.323056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:52.331742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c734eb05-6a3f-46a7-b1b6-f142a202d436 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1715 microversion: 2.1 time: 0.150321 Sep 09 12:11:52.332306 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 302/621] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:52 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:52.396001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:52.396557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:52.403009 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.403493 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.403937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.404626 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.405083 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.405508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.528377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] HTTP exception thrown: Cannot 'detach_volume' instance 072fca7e-cc8f-41e9-9244-26d624d71486 while it is in vm_state rescued Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Request method failure captured: Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments/223eb73f-9738-4f86-ba03-6370b39272c9 HTTP/1.1 Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyw6FWacK_GcSBnmrWuFi4XbfuxIBxobdXnovNrmDXUPO89-OOKUtMPcGhwLEunsRbOLc5glqqdYvnHa3lHfDej0gumsCdYFKI4kUxiL9PXiwD4fE6yC1FhtPRIlP7d97bkJx3cccrs9BGQfM-hX_PmRdSDFpob4bC5QmaybY-i91SE Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:11:52.529982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9860574ff3947e3bc61a76e6883107a"}]}] Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9c0f1bfeb1464f87a7f3ea4add940861 Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:11:52.531350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Cannot 'detach_volume' instance 072fca7e-cc8f-41e9-9244-26d624d71486 while it is in vm_state rescued Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'server_id': '072fca7e-cc8f-41e9-9244-26d624d71486', 'id': '223eb73f-9738-4f86-ba03-6370b39272c9'} Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 072fca7e-cc8f-41e9-9244-26d624d71486 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:11:52.532806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 072fca7e-cc8f-41e9-9244-26d624d71486 while it is in vm_state rescued Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 072fca7e-cc8f-41e9-9244-26d624d71486 while it is in vm_state rescued Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:11:52.534301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Returning 409 to user: Cannot 'detach_volume' instance 072fca7e-cc8f-41e9-9244-26d624d71486 while it is in vm_state rescued {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:11:52.535537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca0e428f-706f-4224-ad5b-a57559a2e280 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "DELETE /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments/223eb73f-9738-4f86-ba03-6370b39272c9" status: 409 len: 152 microversion: 2.1 time: 0.139430 Sep 09 12:11:52.535537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 320/622] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:11:52 2022] DELETE /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments/223eb73f-9738-4f86-ba03-6370b39272c9 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 09 12:11:52.542072 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:52.542669 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:52.548849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.549335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.549776 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.550503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.551086 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.551582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.625903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c32e30e-5f56-47a4-a38f-b34df16cc2ff tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "POST /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/action" status: 202 len: 0 microversion: 2.1 time: 0.087011 Sep 09 12:11:52.626744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 303/623] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:11:52 2022] POST /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:11:52.634711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:52.636027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:52.642732 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.643215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.643651 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.644337 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:52.644789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:52.645212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:52.789340 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:52.797858 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-15dd6687-a870-4ab0-b7dd-bc7169061b14 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1723 microversion: 2.1 time: 0.166930 Sep 09 12:11:52.798477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 321/624] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:52 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:53.822441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:53.823133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:53.830840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:53.831326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:53.831753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:53.832441 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:53.832903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:53.833309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:53.961230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:53.969972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-524d3f2d-34d5-4e65-842f-e4ae1d4eac54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1723 microversion: 2.1 time: 0.151244 Sep 09 12:11:53.970583 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 304/625] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:53 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:54.992650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:54.993200 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:54.995437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=37 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:55.000733 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:55.001218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:55.001655 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:55.002371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:55.002829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:55.003257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:55.007462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:11:55.133098 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:55.141740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22c8e72f-e398-411b-8924-c9353224bb4c tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1723 microversion: 2.1 time: 0.152699 Sep 09 12:11:55.142333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 322/626] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:54 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:56.165784 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:56.166415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:56.172841 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:56.173895 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:56.174394 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:56.175094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:56.175553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:56.175980 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:56.318282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:56.326603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a45117e0-2cd7-4c0c-8638-37a9904be715 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1723 microversion: 2.1 time: 0.164749 Sep 09 12:11:56.327185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 305/627] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:56 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:57.348828 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:57.349456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:57.355946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:57.356422 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:57.356843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:57.357569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:57.357977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:57.358431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:57.487696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:11:57.496072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5c5fa88-98b5-48dd-a05e-efe952d7ef46 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1729 microversion: 2.1 time: 0.151096 Sep 09 12:11:57.496629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 323/628] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:11:57 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:11:57.518872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:11:57.519413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:11:57.525827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:57.526342 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:57.526781 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:57.527469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:57.527923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:57.528346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:57.604376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4b4e7904-63a3-4b24-a316-a879d1c8ae90 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089310 Sep 09 12:11:57.604972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 306/629] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:11:57 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:11:58.768396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-68464d9c-9ac7-48ba-8777-caf4b7bfc736 req-6cfc3b86-4f1b-4044-89f8-778ef9de004c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072fca7e-cc8f-41e9-9244-26d624d71486", "tag": "7a8a023e-5606-4a22-825d-2444697c029b"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:11:58.779420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-68464d9c-9ac7-48ba-8777-caf4b7bfc736 req-6cfc3b86-4f1b-4044-89f8-778ef9de004c service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:11:58.779897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-68464d9c-9ac7-48ba-8777-caf4b7bfc736 req-6cfc3b86-4f1b-4044-89f8-778ef9de004c service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:11:58.780650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-68464d9c-9ac7-48ba-8777-caf4b7bfc736 req-6cfc3b86-4f1b-4044-89f8-778ef9de004c service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:11:58.791826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-68464d9c-9ac7-48ba-8777-caf4b7bfc736 req-6cfc3b86-4f1b-4044-89f8-778ef9de004c service nova] Creating event network-changed:7a8a023e-5606-4a22-825d-2444697c029b for instance 072fca7e-cc8f-41e9-9244-26d624d71486 on hv-cinder-85221 Sep 09 12:11:58.796821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-68464d9c-9ac7-48ba-8777-caf4b7bfc736 req-6cfc3b86-4f1b-4044-89f8-778ef9de004c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101346 Sep 09 12:11:58.797447 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 324/630] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:00.808008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:12:00.808439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:12:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Sep 09 12:12:00.813439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-1497cf9e-2eaa-4ae7-a077-f54832e4676b req-571ebc6e-8339-4393-a3ac-b0c4101c499e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072fca7e-cc8f-41e9-9244-26d624d71486", "tag": "7a8a023e-5606-4a22-825d-2444697c029b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:00.823963 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1497cf9e-2eaa-4ae7-a077-f54832e4676b req-571ebc6e-8339-4393-a3ac-b0c4101c499e service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:00.824438 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1497cf9e-2eaa-4ae7-a077-f54832e4676b req-571ebc6e-8339-4393-a3ac-b0c4101c499e service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:00.824866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-1497cf9e-2eaa-4ae7-a077-f54832e4676b req-571ebc6e-8339-4393-a3ac-b0c4101c499e service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:00.836220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-1497cf9e-2eaa-4ae7-a077-f54832e4676b req-571ebc6e-8339-4393-a3ac-b0c4101c499e service nova] Creating event network-changed:7a8a023e-5606-4a22-825d-2444697c029b for instance 072fca7e-cc8f-41e9-9244-26d624d71486 on hv-cinder-85221 Sep 09 12:12:00.841011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-1497cf9e-2eaa-4ae7-a077-f54832e4676b req-571ebc6e-8339-4393-a3ac-b0c4101c499e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 Sep 09 12:12:00.841576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 307/631] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:12.746840 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:12.747573 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=12 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:12.855181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:12.855786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:12.862471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:12.862947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:12.863374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:12.864050 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:12.864493 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:12.864910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:12.944443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lazy-loading 'services' on Instance uuid 00de6121-bfa1-4888-af77-69a8f8800324 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:12:13.057812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1a9a0dd-d415-4551-a2ca-f1eec7b394b6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-volume_attachments/d2169ba3-d0b9-41a3-a3c2-710d16cce897" status: 202 len: 0 microversion: 2.1 time: 0.313224 Sep 09 12:12:13.058483 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 325/632] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:12:12 2022] DELETE /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-volume_attachments/d2169ba3-d0b9-41a3-a3c2-710d16cce897 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:14.185679 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6ae203c-c324-4486-82f1-658b49c0260f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:14.189096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=13 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:14.189758 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:14.200107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ae203c-c324-4486-82f1-658b49c0260f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:14.200776 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ae203c-c324-4486-82f1-658b49c0260f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:14.201472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ae203c-c324-4486-82f1-658b49c0260f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:14.278737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6ae203c-c324-4486-82f1-658b49c0260f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Going to try to stop instance {{(pid=120719) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 09 12:12:14.321663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6ae203c-c324-4486-82f1-658b49c0260f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action" status: 202 len: 0 microversion: 2.1 time: 0.140213 Sep 09 12:12:14.322332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 308/633] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:12:14 2022] POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:14.332228 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:14.332910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:14.339860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:14.340371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:14.340911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:14.341616 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:14.342074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:14.342531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:14.711370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:14.719166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-00720792-f933-4ace-bbf2-7f6535440132 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.392103 Sep 09 12:12:14.720387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 326/634] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:14 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:15.744238 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:15.745234 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:15.752149 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:15.752635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:15.753071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:15.753770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:15.754254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:15.755148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:15.895640 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:15.903700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6cfa11ac-353e-4ea6-8693-febd467e333e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.164066 Sep 09 12:12:15.904286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 309/635] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:15 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:16.928251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:16.928846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:16.935213 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:16.935697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:16.936139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:16.936824 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:16.937280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:16.937706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:17.069152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:17.076837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5a7245ad-4509-42bb-9bb3-748366ce8bac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.152534 Sep 09 12:12:17.077396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 327/636] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:16 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:18.101292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:18.101892 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:18.108259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:18.108735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:18.109166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:18.109847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:18.110976 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:18.111400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:18.239316 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:18.247861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b90f4358-e77a-4d82-93d8-930f88418757 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.150402 Sep 09 12:12:18.248430 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 310/637] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:18 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:19.271119 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:19.271730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:19.278137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:19.278624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:19.279066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:19.279752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:19.280226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:19.280631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:19.412492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:19.420053 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f4d32452-3be7-44a0-8696-250d5481c832 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.152768 Sep 09 12:12:19.420620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 328/638] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:19 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:20.443887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:20.444566 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:20.450993 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:20.451487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:20.451894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:20.452579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:20.453022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:20.453444 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:20.586916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:20.594704 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fefd202d-c1c3-468d-813f-d3832b74cd60 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.154623 Sep 09 12:12:20.595822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 311/639] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:20 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:21.618921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:21.619780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:21.626203 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:21.626686 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:21.627543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:21.628225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:21.628679 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:21.629097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:21.757490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:21.765249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-acecaa37-7854-4fc3-a4ed-6fa2e485b825 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.150376 Sep 09 12:12:21.765807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 329/640] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:21 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:22.789478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:22.790076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:22.795928 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:22.796402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:22.796832 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:22.797508 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:22.797954 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:22.798395 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:22.928266 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:22.936164 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-396703cf-306c-488d-b96d-f2b2bacfa4dc tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.150646 Sep 09 12:12:22.936767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 312/641] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:22 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:23.961038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:23.961683 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:23.968433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:23.968924 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:23.969351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:23.970038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:23.970559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:23.970986 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:24.099197 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:24.106944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-649c26f5-9a8d-436e-b42b-ad0c97745e76 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1676 microversion: 2.1 time: 0.150847 Sep 09 12:12:24.107500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 330/642] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:23 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:25.131717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:25.132370 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:25.138711 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:25.139188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:25.139620 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:25.140310 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:25.140787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:25.141206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:25.345629 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:25.353853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ae2881a7-cc83-47d7-bd1e-e6ded15b7d33 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1653 microversion: 2.1 time: 0.226553 Sep 09 12:12:25.354400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 313/643] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:25 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1653 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:25.376427 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1d363aea-2d95-4fd7-a8ba-a083d18f39d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:25.383597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d363aea-2d95-4fd7-a8ba-a083d18f39d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:25.384077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d363aea-2d95-4fd7-a8ba-a083d18f39d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:25.384509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1d363aea-2d95-4fd7-a8ba-a083d18f39d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:25.407050 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1d363aea-2d95-4fd7-a8ba-a083d18f39d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Going to try to start instance {{(pid=120720) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 09 12:12:25.451933 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1d363aea-2d95-4fd7-a8ba-a083d18f39d6 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action" status: 202 len: 0 microversion: 2.1 time: 0.079129 Sep 09 12:12:25.452554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 331/644] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:12:25 2022] POST /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:25.461428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:25.462036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:25.467992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:25.468482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:25.468923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:25.469623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:25.470083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:25.470543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:25.605405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:25.613734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-285d4278-65ce-4394-b0d1-034e2c336682 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1662 microversion: 2.1 time: 0.156235 Sep 09 12:12:25.614345 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 314/645] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:25 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:26.639889 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:26.640618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:26.647547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:26.648035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:26.648477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:26.649173 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:26.649625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:26.650045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:26.783181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:26.790929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2c851e43-2cf1-4df0-a4c1-7267494b9e19 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1662 microversion: 2.1 time: 0.155754 Sep 09 12:12:26.791505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 332/646] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:26 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:27.813578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:27.814287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:27.822073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:27.822610 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:27.823057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:27.823754 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:27.824212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:27.824641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:27.858738 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:27.859273 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:27.867025 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:27.867520 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:27.867955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:27.868664 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:27.869117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:27.869805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:27.896674 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0245981c-fb10-4b4b-b108-295756dfc36f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08/ips" status: 200 len: 148 microversion: 2.1 time: 0.098165 Sep 09 12:12:27.897248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 315/647] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:12:27 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08/ips => generated 148 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:27.910559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca57d24b-139b-4cf1-992d-6fa6a1d7b58d"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:27.912908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:27.918999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:27.919488 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:27.919921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:27.920621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:27.921107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:27.921502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:27.961337 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:27.969245 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54e9f58f-aa20-4ab4-9691-de1eea94c89d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1666 microversion: 2.1 time: 0.159487 Sep 09 12:12:27.969819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 333/648] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:27 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:12:28.003671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Invalid volume: volume ca57d24b-139b-4cf1-992d-6fa6a1d7b58d is already attached to instances: 92db74a9-d7a5-4405-919d-b1ae5f3b8381 Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08/os-volume_attachments HTTP/1.1 Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 74 Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:12:28.005390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {"volumeAttachment": {"volumeId": "ca57d24b-139b-4cf1-992d-6fa6a1d7b58d"}} Sep 09 12:12:28.007403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Invalid volume: volume ca57d24b-139b-4cf1-992d-6fa6a1d7b58d is already attached to instances: 92db74a9-d7a5-4405-919d-b1ae5f3b8381 Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'server_id': 'd3a56358-0027-49dc-ba72-8b3d31456c08', 'body': {'volumeAttachment': {'volumeId': 'ca57d24b-139b-4cf1-992d-6fa6a1d7b58d'}}} Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ca57d24b-139b-4cf1-992d-6fa6a1d7b58d is already attached to instances: 92db74a9-d7a5-4405-919d-b1ae5f3b8381 Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:12:28.008360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ca57d24b-139b-4cf1-992d-6fa6a1d7b58d is already attached to instances: 92db74a9-d7a5-4405-919d-b1ae5f3b8381 Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:28.009864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ca57d24b-139b-4cf1-992d-6fa6a1d7b58d is already attached to instances: 92db74a9-d7a5-4405-919d-b1ae5f3b8381 Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 400 to user: Invalid volume: volume ca57d24b-139b-4cf1-992d-6fa6a1d7b58d is already attached to instances: 92db74a9-d7a5-4405-919d-b1ae5f3b8381 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e36e28ee-41ee-4536-bbac-387a85fa8c9c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100889 Sep 09 12:12:28.011560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 316/649] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:12:27 2022] POST /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 09 12:12:28.016457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:28.016943 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:28.023349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:28.023825 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:28.024255 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:28.024927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:28.025380 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:28.025790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:28.055114 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:12:28.140388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-297a14a2-8930-421f-a397-96997ecfaa51 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 204 len: 0 microversion: 2.1 time: 0.127558 Sep 09 12:12:28.141271 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 334/650] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:12:28 2022] DELETE /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:12:28.151761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:28.151976 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:28.158995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:28.159508 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:28.159943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:28.160642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:28.161103 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:28.161532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:28.292595 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:28.300350 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3eb49170-d44a-4561-b840-b73e4538af3c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1676 microversion: 2.1 time: 0.152989 Sep 09 12:12:28.300909 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 317/651] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:28 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:29.324569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:29.325257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:29.332088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:29.332567 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:29.332998 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:29.333696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:29.334141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:29.334561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:29.466215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:29.474587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c714f3ad-2a99-4af6-858c-8e9effb9bb42 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1676 microversion: 2.1 time: 0.154201 Sep 09 12:12:29.475302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 335/652] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:29 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:30.498878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:30.499484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:30.507205 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:30.507682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:30.508112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:30.508805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:30.509252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:30.509677 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:30.757252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:30.764987 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41317bfe-a941-4057-97a6-00ab51424e29 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1676 microversion: 2.1 time: 0.270210 Sep 09 12:12:30.765544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 318/653] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:30 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:31.207865 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-377684a6-ca55-42a5-8067-9b9818d490ac req-9a6b93c7-2e90-4490-bee6-17369fc42bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a56358-0027-49dc-ba72-8b3d31456c08", "name": "network-vif-deleted", "tag": "2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:31.232864 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-377684a6-ca55-42a5-8067-9b9818d490ac req-9a6b93c7-2e90-4490-bee6-17369fc42bf0 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:31.233621 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-377684a6-ca55-42a5-8067-9b9818d490ac req-9a6b93c7-2e90-4490-bee6-17369fc42bf0 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:31.234299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-377684a6-ca55-42a5-8067-9b9818d490ac req-9a6b93c7-2e90-4490-bee6-17369fc42bf0 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:31.246860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-377684a6-ca55-42a5-8067-9b9818d490ac req-9a6b93c7-2e90-4490-bee6-17369fc42bf0 service nova] Creating event network-vif-deleted:2e69e2a6-1cb5-4ee0-b16d-a64b2516cc7d for instance d3a56358-0027-49dc-ba72-8b3d31456c08 on hv-cinder-85221 Sep 09 12:12:31.252294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-377684a6-ca55-42a5-8067-9b9818d490ac req-9a6b93c7-2e90-4490-bee6-17369fc42bf0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048755 Sep 09 12:12:31.253075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 336/654] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:31.788645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:31.789265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:31.797711 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:31.799070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:31.799553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:31.800268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:31.800734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:31.801164 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:31.836814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:31.837296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:31.837731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:31.838206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lazy-loading 'fault' on Instance uuid d3a56358-0027-49dc-ba72-8b3d31456c08 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:12:31.906262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:31.917590 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53350178-017c-4f2a-8694-c821b0f09769 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 200 len: 1328 microversion: 2.1 time: 0.132031 Sep 09 12:12:31.918455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 319/655] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:31 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 1328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:32.946428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:32.947014 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:32.953033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:32.953511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:32.953941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:32.954650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:32.955099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:32.956026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:32.969752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 HTTP/1.1 Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:12:32.972759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:12:32.974367 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': 'd3a56358-0027-49dc-ba72-8b3d31456c08'} Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:32.975278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:12:32.976718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:32.978280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:32.978280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cc7cf84b-5c6a-4b47-8710-f845fe985c09 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 404 len: 111 microversion: 2.1 time: 0.032575 Sep 09 12:12:32.978280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 337/656] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:32 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:12:32.983086 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-24c2c2ed-1fd5-485f-806c-1d52a9506253 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '.version_select at 0x7ff2d92fd700>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:33.007184 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-24c2c2ed-1fd5-485f-806c-1d52a9506253 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-191558161" status: 202 len: 0 microversion: 2.1 time: 0.027851 Sep 09 12:12:33.007768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 320/657] 10.222.0.62 () {58 vars in 1218 bytes} [Fri Sep 9 12:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-191558161 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:33.691811 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:33.692301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:33.698290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:33.698788 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:33.699212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:33.699901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:33.700357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:33.700817 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:33.780401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lazy-loading 'services' on Instance uuid 92db74a9-d7a5-4405-919d-b1ae5f3b8381 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:12:33.842616 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:33.858232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1222b08b-656e-4fa2-989c-a0dc42754b10 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments/ca57d24b-139b-4cf1-992d-6fa6a1d7b58d" status: 202 len: 0 microversion: 2.1 time: 0.170721 Sep 09 12:12:33.859038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 338/658] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:12:33 2022] DELETE /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments/ca57d24b-139b-4cf1-992d-6fa6a1d7b58d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:33.869318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:33.871761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:33.880075 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:33.881270 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:33.881716 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:33.882460 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:33.882921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:33.883359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:33.916562 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8c0e74c2-f451-4ce1-b6c8-8643b29e11d5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051583 Sep 09 12:12:33.917125 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 321/659] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:12:33 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:34.930363 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:34.932709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:34.940399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:34.940920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:34.941353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:34.942058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:34.942547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:34.942974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:34.972843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9437bbeb-c37d-4f50-b8e7-4ae88b768602 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047580 Sep 09 12:12:34.973394 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 339/660] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:12:34 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:12:35.038888 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:35.039463 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:35.045968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:35.046567 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:35.047076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:35.047847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:35.048378 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:35.048874 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:35.073439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:12:35.121619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:35.149925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-071c6d4d-b978-49cd-b56e-d0bd8047208b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 204 len: 0 microversion: 2.1 time: 0.114464 Sep 09 12:12:35.150683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 322/661] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:12:35 2022] DELETE /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:12:35.159625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:35.160221 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:35.166212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:35.166691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:35.167117 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:35.167791 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:35.168234 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:35.168647 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:35.301658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:35.309441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-875afc73-3e9e-4ab2-8f99-74277408323f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1681 microversion: 2.1 time: 0.154302 Sep 09 12:12:35.310012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 340/662] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:35 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:36.333703 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:36.334446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:36.340827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:36.341305 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:36.341735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:36.342451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:36.342897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:36.343313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:36.475487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:36.483400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-65cb8b58-15d6-4524-ba84-725c81d74c06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1681 microversion: 2.1 time: 0.153786 Sep 09 12:12:36.483897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 323/663] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:36 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:37.508116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:37.508790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:37.515522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:37.516035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:37.516447 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:37.517148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:37.517604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:37.518062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:37.591346 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:37.599645 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7dba4987-19bc-4d1b-8d12-77987b1ac9a2 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 200 len: 1613 microversion: 2.1 time: 0.095572 Sep 09 12:12:37.600216 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 341/664] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:37 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:12:37.821999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-2c26ca72-da34-48f1-9c0b-2321e305bbba req-e49eab58-d4e8-44af-b86d-bff0da017679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92db74a9-d7a5-4405-919d-b1ae5f3b8381", "name": "network-vif-deleted", "tag": "0a15142d-5557-498e-a9f0-e6da7b25da7f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:37.832193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2c26ca72-da34-48f1-9c0b-2321e305bbba req-e49eab58-d4e8-44af-b86d-bff0da017679 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:37.832762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2c26ca72-da34-48f1-9c0b-2321e305bbba req-e49eab58-d4e8-44af-b86d-bff0da017679 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:37.833174 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-2c26ca72-da34-48f1-9c0b-2321e305bbba req-e49eab58-d4e8-44af-b86d-bff0da017679 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:37.845218 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-2c26ca72-da34-48f1-9c0b-2321e305bbba req-e49eab58-d4e8-44af-b86d-bff0da017679 service nova] Creating event network-vif-deleted:0a15142d-5557-498e-a9f0-e6da7b25da7f for instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 on hv-cinder-85221 Sep 09 12:12:37.850822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-2c26ca72-da34-48f1-9c0b-2321e305bbba req-e49eab58-d4e8-44af-b86d-bff0da017679 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Sep 09 12:12:37.851438 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 324/665] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:38.624158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:38.624923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:38.632677 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:38.633412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:38.633967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:38.634742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:38.635412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:38.635629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:38.649833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 HTTP/1.1 Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:12:38.651558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:12:38.653062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '92db74a9-d7a5-4405-919d-b1ae5f3b8381'} Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:38.653964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:12:38.655458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:38.656737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:38.656737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-553afa24-d7d4-4093-805b-5cb6cecf02ff tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 404 len: 111 microversion: 2.1 time: 0.037037 Sep 09 12:12:38.658512 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 342/666] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:38 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:12:38.667612 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-25745a79-a771-4d93-8353-dd88cb12dc67 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '.version_select at 0x7ff2d92fdca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:38.690443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-25745a79-a771-4d93-8353-dd88cb12dc67 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051219595" status: 202 len: 0 microversion: 2.1 time: 0.026222 Sep 09 12:12:38.691195 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 325/667] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 9 12:12:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051219595 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:12:39.352345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-31c2b689-12a9-474c-8068-8ff0285a1b5c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: .version_select at 0x7ff2d93eec10>, body: {"keypair": {"name": "tempest-keypair-1081182348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqWcxJcPOwdqMKuopDENFVic5OrxDMkSLXzYipehB++jSY7K+Nn4ZtPKQACbmGB+e6BN7H7yNuNwm81JlTRUcDDf134Y32z+NSu5Nn4LCsV0GUA1fH4SleP1lfiVAZb2w=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:39.368136 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-31c2b689-12a9-474c-8068-8ff0285a1b5c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:12:39.372231 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-31c2b689-12a9-474c-8068-8ff0285a1b5c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:12:39.394484 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-31c2b689-12a9-474c-8068-8ff0285a1b5c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046436 Sep 09 12:12:39.395073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 343/668] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:12:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:40.615886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-270014424", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846b424-a53d-4e1e-9d8f-617b0d2b2566"}], "security_groups": [{"name": "tempest-securitygroup--568933701"}], "key_name": "tempest-keypair-1081182348", "user_data": "}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:40.720485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] validate_networks() for [('f846b424-a53d-4e1e-9d8f-617b0d2b2566', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:12:41.131765 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:12:41.132189 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:12:41.132698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:12:41.133114 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:12:41.133575 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:12:41.142834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:41.143317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:41.143754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:41.144516 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:41.144970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:41.145395 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:41.164027 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:12:41.168035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:12:41.180427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:12:41.182872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:12:41.232484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ff659199-834f-4419-8ac1-d734fa5755c3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621309 Sep 09 12:12:41.233454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 326/669] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:12:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:12:41.245687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ee95e89-9d78-4f12-b704-20ee681c8c99 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:41.246541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ee95e89-9d78-4f12-b704-20ee681c8c99 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:41.302588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ee95e89-9d78-4f12-b704-20ee681c8c99 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:41.309561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ee95e89-9d78-4f12-b704-20ee681c8c99 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1241 microversion: 2.1 time: 0.068505 Sep 09 12:12:41.310154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 344/670] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:41 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:42.333177 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:42.333785 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:42.340464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:42.340932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:42.341359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:42.342040 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:42.342518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:42.342934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:42.406936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:42.415226 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3119add1-8399-436c-ad2a-d9e1f30c385f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1293 microversion: 2.1 time: 0.085910 Sep 09 12:12:42.415791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 327/671] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:42 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:43.438321 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:43.438934 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:43.441571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:43.448470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.449001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.449509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.450175 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.450752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.451062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.514516 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:43.515042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:43.523068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.523859 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.524301 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.524998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.525626 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.526082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.563588 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-67cb012e-419b-45c1-b299-c5390525b557 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments/d9a18af5-3470-49c6-8bca-f4bd29a8759a" status: 200 len: 194 microversion: 2.20 time: 0.053623 Sep 09 12:12:43.564820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 328/672] 10.222.0.62 () {60 vars in 1454 bytes} [Fri Sep 9 12:12:43 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments/d9a18af5-3470-49c6-8bca-f4bd29a8759a => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:12:43.597980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:43.605830 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4cbee904-c685-4c29-96e6-2bab89fb890c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.171414 Sep 09 12:12:43.610524 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 345/673] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:43 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:43.655460 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:43.656427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:43.663077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.664295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.664652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.665359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.665818 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.666276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.792424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lazy-loading 'services' on Instance uuid 214a4341-91a9-4b8e-b1db-4e07620cfbf7 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:12:43.908822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-912d0d9f-dfb6-46ca-aa05-9791c6214ad0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments/d9a18af5-3470-49c6-8bca-f4bd29a8759a" status: 202 len: 0 microversion: 2.20 time: 0.257108 Sep 09 12:12:43.909419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 329/674] 10.222.0.62 () {60 vars in 1457 bytes} [Fri Sep 9 12:12:43 2022] DELETE /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments/d9a18af5-3470-49c6-8bca-f4bd29a8759a => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:12:43.917963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:43.920301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:43.933817 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.934747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.935157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.936129 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:43.936610 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:43.937069 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:43.972522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca056af3-bca9-4eef-9053-488668843d31 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058547 Sep 09 12:12:43.973810 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 346/675] 10.222.0.62 () {60 vars in 1343 bytes} [Fri Sep 9 12:12:43 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:12:44.144834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9922cc3c-e17c-4036-aa94-41511b1ff143 req-6c67c5eb-a55d-40cf-8312-6da3fb759057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45fc4606-72de-4cf6-842b-58f6a51f0f12", "tag": "65247ac2-80ca-4fab-a247-ddd3cd753758"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:44.154458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9922cc3c-e17c-4036-aa94-41511b1ff143 req-6c67c5eb-a55d-40cf-8312-6da3fb759057 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:44.154923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9922cc3c-e17c-4036-aa94-41511b1ff143 req-6c67c5eb-a55d-40cf-8312-6da3fb759057 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:44.155353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9922cc3c-e17c-4036-aa94-41511b1ff143 req-6c67c5eb-a55d-40cf-8312-6da3fb759057 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:44.166576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9922cc3c-e17c-4036-aa94-41511b1ff143 req-6c67c5eb-a55d-40cf-8312-6da3fb759057 service nova] Creating event network-changed:65247ac2-80ca-4fab-a247-ddd3cd753758 for instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 on hv-cinder-85221 Sep 09 12:12:44.171381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9922cc3c-e17c-4036-aa94-41511b1ff143 req-6c67c5eb-a55d-40cf-8312-6da3fb759057 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030545 Sep 09 12:12:44.172154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 330/676] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:44.636967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:44.639973 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:44.647869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:44.648358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:44.649015 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:44.649841 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:44.650318 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:44.650932 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:44.794592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:44.802663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0cd742aa-0d20-40eb-ac0c-a1e52f60f944 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.169653 Sep 09 12:12:44.803258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 347/677] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:44 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:44.986500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:44.988756 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:44.991058 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:44.998540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:44.999067 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:44.999519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.000216 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:45.000667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:45.001091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.034918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cd3d0a71-ee83-46fc-aff6-98f13e8ae7e5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053549 Sep 09 12:12:45.040857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 331/678] 10.222.0.62 () {60 vars in 1343 bytes} [Fri Sep 9 12:12:44 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:12:45.097852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.098377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:45.104430 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:45.104914 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:45.105350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.106041 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:45.106525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:45.106948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.134033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:12:45.215855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8803a6ce-f864-46fe-906c-e67a8586b674 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 204 len: 0 microversion: 2.20 time: 0.121708 Sep 09 12:12:45.218844 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 348/679] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 9 12:12:45 2022] DELETE /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 12:12:45.228238 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.228990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:45.236319 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:45.237318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:45.237761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.238581 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:45.239043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:45.239690 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.372088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:45.380388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:45.381827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:45.383017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6fa74f33-b4ed-4513-bee8-1892e8c455cb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.160837 Sep 09 12:12:45.383581 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 332/680] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:45 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:45.825330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:45.826020 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:45.833037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:45.833509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:45.833943 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.834665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:45.835119 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:45.835531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:45.965599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:45.973358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b0b8b6d8-af0b-4ba8-94f7-3aba42204fde tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.152280 Sep 09 12:12:45.973928 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 349/681] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:45 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:46.408968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:46.409582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:46.416048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:46.416530 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:46.416965 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:46.417658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:46.418136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:46.418565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:46.547415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:46.556138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:46.557611 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:46.558809 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-81b003c2-c114-428e-8bbc-1620bf20ba6b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.153805 Sep 09 12:12:46.559368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 333/682] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:46 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:46.996426 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:46.997826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:47.004840 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:47.005315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:47.005749 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:47.006479 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:47.006938 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:47.007374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:47.140706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:47.149244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0526c5c4-908c-4e7f-8028-2c4b8b1c7cec tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.157162 Sep 09 12:12:47.150161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 350/683] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:46 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:47.585254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:47.585881 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:47.592845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:47.593334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:47.593770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:47.594498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:47.594955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:47.595386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:47.730844 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:47.739198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:47.740650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:47.741802 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f502e4b-8cef-4e34-8c7d-8aecfd6808ed tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.160753 Sep 09 12:12:47.742396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 334/684] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:47 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:48.172844 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:48.173436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:48.180694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:48.181179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:48.181617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:48.182352 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:48.182812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:48.183238 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:48.315832 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:48.323429 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8cf3bc0e-2b6c-4544-92c0-077a6eddc192 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.154574 Sep 09 12:12:48.324005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 351/685] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:48 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:48.769091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:48.769709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:48.776249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:48.776754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:48.777195 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:48.777889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:48.778400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:48.778832 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:48.907201 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:48.915469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:48.916840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:48.917982 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9132efde-3096-4198-9217-ef98e1f079ca tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1724 microversion: 2.20 time: 0.153658 Sep 09 12:12:48.918574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 335/686] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:48 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:49.346667 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:49.347273 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:49.353646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:49.354138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:49.354581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:49.355272 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:49.355726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:49.356141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:49.488856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:49.498601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b209cf87-aa53-4adf-b686-b4584536cee5 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.156286 Sep 09 12:12:49.499296 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 352/687] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:49 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:49.942850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:49.943585 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:49.949906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:49.950416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:49.950849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:49.951542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:49.951992 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:49.952656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:50.030357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:50.040137 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:50.041556 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:50.042753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2c28b131-abfd-4508-8fb2-79fd4c523b4d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 200 len: 1657 microversion: 2.20 time: 0.103853 Sep 09 12:12:50.043312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 336/688] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:49 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 1657 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:50.149444 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-828eb03a-9bc8-45c8-81bf-a14ff12164e5 req-29a4698f-9e73-4236-985a-4ac9ee6b7769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214a4341-91a9-4b8e-b1db-4e07620cfbf7", "name": "network-vif-deleted", "tag": "5d843f0d-cb60-459b-ab64-c48fbc48049a"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:50.161544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-828eb03a-9bc8-45c8-81bf-a14ff12164e5 req-29a4698f-9e73-4236-985a-4ac9ee6b7769 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:50.162028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-828eb03a-9bc8-45c8-81bf-a14ff12164e5 req-29a4698f-9e73-4236-985a-4ac9ee6b7769 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:50.162487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-828eb03a-9bc8-45c8-81bf-a14ff12164e5 req-29a4698f-9e73-4236-985a-4ac9ee6b7769 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:50.187002 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-828eb03a-9bc8-45c8-81bf-a14ff12164e5 req-29a4698f-9e73-4236-985a-4ac9ee6b7769 service nova] Creating event network-vif-deleted:5d843f0d-cb60-459b-ab64-c48fbc48049a for instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 on hv-cinder-85221 Sep 09 12:12:50.193055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-828eb03a-9bc8-45c8-81bf-a14ff12164e5 req-29a4698f-9e73-4236-985a-4ac9ee6b7769 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051517 Sep 09 12:12:50.197106 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 353/689] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:50.522142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:50.523109 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:50.529227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:50.529941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:50.530409 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:50.531109 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:50.531555 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:50.531973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:50.669186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:50.677212 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c69b1180-4857-40f3-9314-0467f69e38e8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.160170 Sep 09 12:12:50.677871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 337/690] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:50 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:51.070051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:51.070836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:51.077357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:51.077837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:51.078312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:51.079006 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:51.079451 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:51.079929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:51.094310 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] HTTP exception thrown: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Request method failure captured: Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 HTTP/1.1 Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxF-zHJ8xYgKP4LcVxzdbpd5LxDxHPR3J-OTO_uZzlE5y7zqqe3LU-qEgzF_ZD-XFl__0bZ5h2tQjH9B640qUp9JpF_B0mzOqq4hIMs_8sMGOE8xnqghV1dMsTYkH7MRMNl8LluOeuHQzVILD4zndkWoO6kURWYviphYjWHWELSKnI Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:12:51.096649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/002ffc44d77748ae9c618229e21f41e8"}]}] Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9676597a1b884138bf5435f3b6cd63c1 Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:12:51.098299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '214a4341-91a9-4b8e-b1db-4e07620cfbf7'} Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:12:51.099251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:12:51.100981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:12:51.102703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Returning 404 to user: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:12:51.102703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-13864306-f91c-4948-b649-e5164e50d5a7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 404 len: 111 microversion: 2.20 time: 0.032748 Sep 09 12:12:51.102703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 354/691] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:51 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:12:51.106944 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b43f3d5-8368-477b-a7b8-ee17c5744f69 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '.version_select at 0x7ff2d935f160>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:51.127822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b43f3d5-8368-477b-a7b8-ee17c5744f69 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-927031755" status: 204 len: 0 microversion: 2.20 time: 0.024008 Sep 09 12:12:51.127822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 338/692] 10.222.0.62 () {60 vars in 1259 bytes} [Fri Sep 9 12:12:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-927031755 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 12:12:51.699364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:51.700274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:51.703973 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:51.708685 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:51.709174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:51.709611 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:51.710339 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:51.710798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:51.711224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:51.794870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:51.795735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:51.800897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69e19345-458c-4c4b-9ad3-f4f228d366fa tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'create', calling method: .version_select at 0x7ff2d92d8d30>, body: {"keypair": {"name": "tempest-keypair-368523301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrFnTbskjbhKFd8yD6Ec5C8NKiTF7vp0GFP1ASuJ2ioRB8MWL6PAPO6OFNMIEUxtf0Hz9+Jc4hTn9cpR9liqc7kQqvrovT/tbDUEbwdI/1UPQE9gyFieKpavXAthGnEBg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:51.817993 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-69e19345-458c-4c4b-9ad3-f4f228d366fa tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for project 002ffc44d77748ae9c618229e21f41e8. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:12:51.822497 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-69e19345-458c-4c4b-9ad3-f4f228d366fa tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for user 9676597a1b884138bf5435f3b6cd63c1 and project 002ffc44d77748ae9c618229e21f41e8. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:12:51.846784 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69e19345-458c-4c4b-9ad3-f4f228d366fa tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052593 Sep 09 12:12:51.847401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 339/693] 10.222.0.62 () {62 vars in 1200 bytes} [Fri Sep 9 12:12:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 09 12:12:51.865298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:51.873112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92b46ce9-2c74-4f32-9dd7-18fffa486015 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.177656 Sep 09 12:12:51.873692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 355/694] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:51 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:52.898418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:52.899191 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:52.905834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:52.906361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:52.906910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:52.907638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:52.908102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:52.908531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:53.141472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:53.151625 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-118bf847-3bbe-4fe2-8f87-0ef5b64f5ac6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.257886 Sep 09 12:12:53.152262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 340/695] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:52 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:53.184482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-918183014", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8739d8a-5ea8-482d-9e17-15514c43a160"}], "security_groups": [{"name": "tempest-securitygroup--1922929740"}], "key_name": "tempest-keypair-368523301", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:53.301248 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] validate_networks() for [('d8739d8a-5ea8-482d-9e17-15514c43a160', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:12:53.346795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a7fb2e42-4358-49f8-84df-414b40d07db4 req-aa7e5824-cc79-49b1-baa4-10fa446b03a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fc4606-72de-4cf6-842b-58f6a51f0f12", "name": "network-vif-plugged", "status": "completed", "tag": "65247ac2-80ca-4fab-a247-ddd3cd753758"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:53.360565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7fb2e42-4358-49f8-84df-414b40d07db4 req-aa7e5824-cc79-49b1-baa4-10fa446b03a6 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:53.361148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7fb2e42-4358-49f8-84df-414b40d07db4 req-aa7e5824-cc79-49b1-baa4-10fa446b03a6 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:53.361573 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a7fb2e42-4358-49f8-84df-414b40d07db4 req-aa7e5824-cc79-49b1-baa4-10fa446b03a6 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:53.373312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a7fb2e42-4358-49f8-84df-414b40d07db4 req-aa7e5824-cc79-49b1-baa4-10fa446b03a6 service nova] Creating event network-vif-plugged:65247ac2-80ca-4fab-a247-ddd3cd753758 for instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 on hv-cinder-85221 Sep 09 12:12:53.379043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a7fb2e42-4358-49f8-84df-414b40d07db4 req-aa7e5824-cc79-49b1-baa4-10fa446b03a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098355 Sep 09 12:12:53.379710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 341/696] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:12:53.750694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:12:53.751149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:12:53.752236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:12:53.752682 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:12:53.753097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:12:53.762326 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:53.762816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:53.763249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:53.764060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:53.764465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:53.764891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:53.781496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for project 002ffc44d77748ae9c618229e21f41e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:12:53.785542 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Getting quotas for user 9676597a1b884138bf5435f3b6cd63c1 and project 002ffc44d77748ae9c618229e21f41e8. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:12:53.796754 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:12:53.799720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:12:53.848292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ef4a163-863f-4c0b-a623-96b7e18740f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.668362 Sep 09 12:12:53.848945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 356/697] 10.222.0.62 () {62 vars in 1188 bytes} [Fri Sep 9 12:12:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 09 12:12:53.860568 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-98b376c8-6c9a-4037-9bae-9cef6ab5bd5b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:53.861896 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-98b376c8-6c9a-4037-9bae-9cef6ab5bd5b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:53.916869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-98b376c8-6c9a-4037-9bae-9cef6ab5bd5b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:53.924852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-98b376c8-6c9a-4037-9bae-9cef6ab5bd5b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:53.926351 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-98b376c8-6c9a-4037-9bae-9cef6ab5bd5b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:53.927817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-98b376c8-6c9a-4037-9bae-9cef6ab5bd5b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1280 microversion: 2.20 time: 0.071249 Sep 09 12:12:53.928849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 342/698] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:53 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:54.179557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:54.180179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:54.187206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:54.187838 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:54.188295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:54.189079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:54.189535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:54.189958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:54.330329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:54.337993 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d8bcfb4a-9954-4f83-a614-6697775c59a0 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1366 microversion: 2.1 time: 0.162293 Sep 09 12:12:54.338593 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 357/699] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:54 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:54.953280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:54.953842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:54.961692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:54.962202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:54.962634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:54.963328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:54.963779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:54.964227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:55.026494 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:55.035938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:55.037380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:55.038523 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c18ee347-c924-4a20-9fb3-00a786746a67 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1332 microversion: 2.20 time: 0.089585 Sep 09 12:12:55.039083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 343/700] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:54 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:55.360831 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:55.361443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:55.367892 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:55.368405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:55.368844 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:55.369784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:55.370268 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:55.370697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:55.388481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:55.502543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:55.510139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a8f4864-a33a-4a19-9e8d-3b4be7525040 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1555 microversion: 2.1 time: 0.153200 Sep 09 12:12:55.510720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 358/701] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:12:55 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:12:55.532476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:55.533503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:55.539664 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:55.540153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:55.540599 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:55.541325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:55.541838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:55.542311 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:55.620336 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4320d27f-31fc-4939-87e2-ecb9ce7bb305 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091387 Sep 09 12:12:55.620948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 344/702] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:12:55 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:56.064743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:56.065265 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:56.071794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:56.072285 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:56.072724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:56.074435 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:56.075281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:56.075727 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:56.146370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:56.156314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:56.157766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:56.159650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-135042ad-5a7f-465b-9ea7-a9c4eec03642 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1332 microversion: 2.20 time: 0.099105 Sep 09 12:12:56.160460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 359/703] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:56 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:57.150001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9ecf9796-3abd-4ce6-9af0-09dbe89af2be req-45195ecf-cfa5-45b1-90e3-552b3d183e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45fc4606-72de-4cf6-842b-58f6a51f0f12", "tag": "65247ac2-80ca-4fab-a247-ddd3cd753758"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:57.160507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ecf9796-3abd-4ce6-9af0-09dbe89af2be req-45195ecf-cfa5-45b1-90e3-552b3d183e6b service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:57.160989 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ecf9796-3abd-4ce6-9af0-09dbe89af2be req-45195ecf-cfa5-45b1-90e3-552b3d183e6b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:57.161419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9ecf9796-3abd-4ce6-9af0-09dbe89af2be req-45195ecf-cfa5-45b1-90e3-552b3d183e6b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:57.174520 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9ecf9796-3abd-4ce6-9af0-09dbe89af2be req-45195ecf-cfa5-45b1-90e3-552b3d183e6b service nova] Creating event network-changed:65247ac2-80ca-4fab-a247-ddd3cd753758 for instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 on hv-cinder-85221 Sep 09 12:12:57.184807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:57.185414 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:57.188868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9ecf9796-3abd-4ce6-9af0-09dbe89af2be req-45195ecf-cfa5-45b1-90e3-552b3d183e6b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033781 Sep 09 12:12:57.189638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 345/704] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:57.197326 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:57.198072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:57.198712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:57.200735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:57.201185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:57.201615 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:57.304987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:57.315178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:57.321888 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:57.324129 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09b5d90b-3075-46d2-9357-3ac36fa947bf tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1338 microversion: 2.20 time: 0.142835 Sep 09 12:12:57.325146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 360/705] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:57 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1338 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:58.355390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:58.356149 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:58.362820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:58.363299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:58.363729 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:58.364704 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:58.365159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:58.365577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:58.386952 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:12:58.583249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:58.591293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:58.592724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:58.593825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ecbad353-4b76-4b61-88bb-0149cffce1e9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.243160 Sep 09 12:12:58.596513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 346/706] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:58 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:12:59.212816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6b2d5004-6d60-4cba-85c2-1cf73201e2ed req-d2cf054c-8931-4cba-affe-7161ee127a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a483ee57-2187-4440-8e0d-10a5fedec303", "tag": "77b9c61a-9f4b-48fb-a52b-6900d4ee0b57"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:12:59.223333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b2d5004-6d60-4cba-85c2-1cf73201e2ed req-d2cf054c-8931-4cba-affe-7161ee127a00 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:59.223804 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b2d5004-6d60-4cba-85c2-1cf73201e2ed req-d2cf054c-8931-4cba-affe-7161ee127a00 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:59.224226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6b2d5004-6d60-4cba-85c2-1cf73201e2ed req-d2cf054c-8931-4cba-affe-7161ee127a00 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:59.235174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6b2d5004-6d60-4cba-85c2-1cf73201e2ed req-d2cf054c-8931-4cba-affe-7161ee127a00 service nova] Creating event network-changed:77b9c61a-9f4b-48fb-a52b-6900d4ee0b57 for instance a483ee57-2187-4440-8e0d-10a5fedec303 on hv-cinder-85221 Sep 09 12:12:59.240140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6b2d5004-6d60-4cba-85c2-1cf73201e2ed req-d2cf054c-8931-4cba-affe-7161ee127a00 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030963 Sep 09 12:12:59.240712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 361/707] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:12:59.618891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:12:59.619733 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:12:59.627463 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:59.628036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:59.628428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:59.629138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:12:59.629875 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:12:59.630719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:12:59.768226 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:59.776241 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:59.777670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:12:59.778807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8de0c6a3-557d-44b5-86da-78f77dea949f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.163956 Sep 09 12:12:59.779370 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 347/708] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:12:59 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:00.804627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:00.805348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:00.811509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:00.811979 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:00.812406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:00.813085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:00.813527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:00.813939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:00.949776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:00.958338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:00.959785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:00.960892 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-59d9c991-d675-4d3d-b40d-1d5341cfadee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.160995 Sep 09 12:13:00.961450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 362/709] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:00 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:01.985057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:01.985690 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:01.992904 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:01.993389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:01.993827 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:01.994826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:01.995284 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:01.995712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:02.127421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:02.135709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:02.137142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:02.138278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f57e91d5-ba88-4ad0-938a-398ab481f7c1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.157169 Sep 09 12:13:02.138836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 348/710] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:01 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:03.162648 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:03.163295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:03.171083 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:03.171581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:03.172027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:03.172727 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:03.173183 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:03.173705 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:03.312015 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:03.320780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:03.322312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:03.323509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0edac156-21ca-4f01-9a8c-5ee41e807d60 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.165622 Sep 09 12:13:03.323509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 363/711] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:03 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:03.404607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:03.405189 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:03.412427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:03.412903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:03.413335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:03.414030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:03.415045 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:03.415045 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:03.495302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lazy-loading 'services' on Instance uuid 072fca7e-cc8f-41e9-9244-26d624d71486 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:13:03.574052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-884fae6e-c446-45a6-a600-0e055f2745ec tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "DELETE /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments/223eb73f-9738-4f86-ba03-6370b39272c9" status: 202 len: 0 microversion: 2.1 time: 0.173143 Sep 09 12:13:03.575097 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 349/712] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:13:03 2022] DELETE /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments/223eb73f-9738-4f86-ba03-6370b39272c9 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:13:03.583569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:03.585893 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:03.592335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:03.592899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:03.593340 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:03.594057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:03.594547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:03.594969 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:03.626668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72379f22-142f-4499-b060-f7120a75741e tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Sep 09 12:13:03.627823 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 364/713] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:13:03 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:04.352252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:04.353124 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:04.355107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:04.362064 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.363302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.363302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.363981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.364440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.364866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.497352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:04.505522 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:04.506985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:04.508115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e84d5ae-9da1-4431-8a24-4af9d48c6981 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.160331 Sep 09 12:13:04.508680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 350/714] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:04 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:04.639911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:04.642609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:04.645867 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:04.646571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:04.654865 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.655360 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.655800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.656779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.657245 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.658473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.692607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6d3fb466-7c62-4260-8fca-29e3db33a7be tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056812 Sep 09 12:13:04.693246 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 365/715] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:13:04 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:13:04.775854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:04.776279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:04.782208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.782727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.783763 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.784485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.784974 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.785403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.810950 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:13:04.885880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8b8ff8a2-09df-4ba2-913a-a663fae94d54 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "DELETE /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 204 len: 0 microversion: 2.1 time: 0.113596 Sep 09 12:13:04.886565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 351/716] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:13:04 2022] DELETE /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:13:04.895255 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:04.895872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:04.901802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.902333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.902774 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:04.903462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:04.903925 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:04.904392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:05.034465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:05.042160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a76cf3ed-b34d-4964-932b-e651eca94670 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1689 microversion: 2.1 time: 0.151285 Sep 09 12:13:05.042728 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 366/717] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:04 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:05.359389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f31987a8-c664-4d06-9f96-a0504cbcf89f req-32c0f9d6-f487-4647-9148-bdf355746241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a483ee57-2187-4440-8e0d-10a5fedec303", "name": "network-vif-plugged", "status": "completed", "tag": "77b9c61a-9f4b-48fb-a52b-6900d4ee0b57"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:05.370552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f31987a8-c664-4d06-9f96-a0504cbcf89f req-32c0f9d6-f487-4647-9148-bdf355746241 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:05.371050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f31987a8-c664-4d06-9f96-a0504cbcf89f req-32c0f9d6-f487-4647-9148-bdf355746241 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:05.371935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f31987a8-c664-4d06-9f96-a0504cbcf89f req-32c0f9d6-f487-4647-9148-bdf355746241 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:05.383699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f31987a8-c664-4d06-9f96-a0504cbcf89f req-32c0f9d6-f487-4647-9148-bdf355746241 service nova] Creating event network-vif-plugged:77b9c61a-9f4b-48fb-a52b-6900d4ee0b57 for instance a483ee57-2187-4440-8e0d-10a5fedec303 on hv-cinder-85221 Sep 09 12:13:05.388806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f31987a8-c664-4d06-9f96-a0504cbcf89f req-32c0f9d6-f487-4647-9148-bdf355746241 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033506 Sep 09 12:13:05.389808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 352/718] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:05.533710 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:05.534366 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:05.540418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:05.540931 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:05.541373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:05.542058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:05.542542 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:05.542969 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:05.673072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:05.681219 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:05.682705 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:05.683807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c965efbb-9d84-4f1b-97dd-c4722d4ac246 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.154711 Sep 09 12:13:05.684374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 367/719] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:05 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:06.065957 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:06.066678 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:06.073317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:06.073795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:06.074271 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:06.074966 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:06.075426 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:06.075853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:06.207840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:06.215514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-36bdadd4-a22f-4bfa-bc2a-e106fa2d2878 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1689 microversion: 2.1 time: 0.153869 Sep 09 12:13:06.216102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 353/720] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:06 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:06.708974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:06.709585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:06.716099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:06.716571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:06.716999 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:06.717676 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:06.718137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:06.718569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:06.859520 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:06.867478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:06.868906 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:06.870295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18817b2b-25c2-4e23-9de8-efe713f10ac4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.165989 Sep 09 12:13:06.870852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 368/721] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:06 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:07.239520 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:07.240160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:07.247001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.247606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.248050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:07.248741 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.249194 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.249619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:07.379279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:07.386942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4dc48dd9-2347-49ec-8872-8cffda04ac64 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1689 microversion: 2.1 time: 0.151859 Sep 09 12:13:07.387505 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 354/722] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:07 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:07.896161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:07.896786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:07.903475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.903966 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.904407 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:07.905110 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:07.905564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:07.905995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:08.034878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:08.042992 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:08.044437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:08.045545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bc654501-bed8-4f5f-a724-2916ec2fc7fc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.153923 Sep 09 12:13:08.046108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 369/723] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:07 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:08.409843 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:08.410478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:08.417628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:08.418148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:08.418584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:08.419279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:08.419741 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:08.420168 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:08.547756 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:08.556335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-efb22cbb-6a4d-41b5-888b-d2b7002d5acc tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1689 microversion: 2.1 time: 0.150311 Sep 09 12:13:08.556906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 355/724] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:08 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:09.070102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:09.070704 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:09.077044 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:09.077520 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:09.077954 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:09.078658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:09.079108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:09.079525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:09.210720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:09.218628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:09.220048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:09.222036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-16300ad3-e388-4625-aae0-d6e8e9dcb40e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1406 microversion: 2.20 time: 0.155926 Sep 09 12:13:09.222634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 370/725] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:09 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:09.578803 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:09.580207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:09.586799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:09.587285 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:09.587718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:09.588413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:09.588864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:09.589287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:09.731491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:09.739395 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fd325986-2cee-42b6-8fd1-85b73db11038 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1689 microversion: 2.1 time: 0.164366 Sep 09 12:13:09.739977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 356/726] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:09 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:10.248370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:10.249011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:10.256894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:10.257390 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:10.257857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.258605 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:10.259059 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:10.259484 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.403244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:10.411168 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:10.412731 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:10.413868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-41b23dab-1f14-4e3d-a8ac-1eb0a1813b1a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1598 microversion: 2.20 time: 0.169827 Sep 09 12:13:10.414453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 371/727] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:13:10 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:13:10.439614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:10.440116 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:10.446359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:10.446936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:10.447433 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.448204 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:10.448723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:10.449209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.559536 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d79d133d-e64b-4cad-9d03-141e8e70b062 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.124305 Sep 09 12:13:10.560167 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 357/728] 10.222.0.62 () {60 vars in 1316 bytes} [Fri Sep 9 12:13:10 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 09 12:13:10.771007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:10.771868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:10.778694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:10.779185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:10.779619 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.780584 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:10.781140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:10.781637 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.862469 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:10.873361 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2e709a7a-8933-4bea-b36f-069827973332 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 200 len: 1621 microversion: 2.1 time: 0.113970 Sep 09 12:13:10.874678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 372/729] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:10 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 1621 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:10.896342 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-cc24f179-09c2-4a81-b3fd-ed480d345ba1 req-fe63a3c7-2acf-47ac-946b-c849bf7658aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072fca7e-cc8f-41e9-9244-26d624d71486", "name": "network-vif-deleted", "tag": "7a8a023e-5606-4a22-825d-2444697c029b"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:10.907108 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cc24f179-09c2-4a81-b3fd-ed480d345ba1 req-fe63a3c7-2acf-47ac-946b-c849bf7658aa service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:10.907983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cc24f179-09c2-4a81-b3fd-ed480d345ba1 req-fe63a3c7-2acf-47ac-946b-c849bf7658aa service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:10.908681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-cc24f179-09c2-4a81-b3fd-ed480d345ba1 req-fe63a3c7-2acf-47ac-946b-c849bf7658aa service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:10.921759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-cc24f179-09c2-4a81-b3fd-ed480d345ba1 req-fe63a3c7-2acf-47ac-946b-c849bf7658aa service nova] Creating event network-vif-deleted:7a8a023e-5606-4a22-825d-2444697c029b for instance 072fca7e-cc8f-41e9-9244-26d624d71486 on hv-cinder-85221 Sep 09 12:13:10.928369 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-cc24f179-09c2-4a81-b3fd-ed480d345ba1 req-fe63a3c7-2acf-47ac-946b-c849bf7658aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 Sep 09 12:13:10.929579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 358/730] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:11.661181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-5dbb3fdc-3135-4554-b412-405cb06d03e4 req-a0ec677f-cbcd-4f16-9c36-3b1d801ebd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a483ee57-2187-4440-8e0d-10a5fedec303", "tag": "77b9c61a-9f4b-48fb-a52b-6900d4ee0b57"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:11.675442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5dbb3fdc-3135-4554-b412-405cb06d03e4 req-a0ec677f-cbcd-4f16-9c36-3b1d801ebd14 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:11.676962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5dbb3fdc-3135-4554-b412-405cb06d03e4 req-a0ec677f-cbcd-4f16-9c36-3b1d801ebd14 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:11.677658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-5dbb3fdc-3135-4554-b412-405cb06d03e4 req-a0ec677f-cbcd-4f16-9c36-3b1d801ebd14 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:11.708000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-5dbb3fdc-3135-4554-b412-405cb06d03e4 req-a0ec677f-cbcd-4f16-9c36-3b1d801ebd14 service nova] Creating event network-changed:77b9c61a-9f4b-48fb-a52b-6900d4ee0b57 for instance a483ee57-2187-4440-8e0d-10a5fedec303 on hv-cinder-85221 Sep 09 12:13:11.713525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-5dbb3fdc-3135-4554-b412-405cb06d03e4 req-a0ec677f-cbcd-4f16-9c36-3b1d801ebd14 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122193 Sep 09 12:13:11.715004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 373/731] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:11.900018 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:11.901574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 072fca7e-cc8f-41e9-9244-26d624d71486] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:11.908944 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:11.909424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:11.910198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:11.911347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:11.912004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:11.912585 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:11.927476 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] HTTP exception thrown: Instance 072fca7e-cc8f-41e9-9244-26d624d71486 could not be found. Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Request method failure captured: Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 HTTP/1.1 Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyw6FWacK_GcSBnmrWuFi4XbfuxIBxobdXnovNrmDXUPO89-OOKUtMPcGhwLEunsRbOLc5glqqdYvnHa3lHfDej0gumsCdYFKI4kUxiL9PXiwD4fE6yC1FhtPRIlP7d97bkJx3cccrs9BGQfM-hX_PmRdSDFpob4bC5QmaybY-i91SE Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:13:11.930552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9860574ff3947e3bc61a76e6883107a"}]}] Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 9c0f1bfeb1464f87a7f3ea4add940861 Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 072fca7e-cc8f-41e9-9244-26d624d71486 could not be found. Sep 09 12:13:11.932146 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '072fca7e-cc8f-41e9-9244-26d624d71486'} Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 072fca7e-cc8f-41e9-9244-26d624d71486 could not be found. Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:13:11.933022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 072fca7e-cc8f-41e9-9244-26d624d71486 could not be found. Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 072fca7e-cc8f-41e9-9244-26d624d71486 could not be found. Sep 09 12:13:11.934450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:11.936657 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Returning 404 to user: Instance 072fca7e-cc8f-41e9-9244-26d624d71486 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:13:11.937681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-016a018a-93d6-4c43-b78f-0e8a20d18aa0 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486" status: 404 len: 111 microversion: 2.1 time: 0.042869 Sep 09 12:13:11.941818 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 359/732] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:11 2022] GET /compute/v2.1/servers/072fca7e-cc8f-41e9-9244-26d624d71486 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:13:11.948671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e74292df-e744-4689-a2f5-02b8c5291b1a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '.version_select at 0x7ff2d92dd8b0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:11.972692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e74292df-e744-4689-a2f5-02b8c5291b1a tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007364621" status: 202 len: 0 microversion: 2.1 time: 0.029413 Sep 09 12:13:11.976439 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 374/733] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 9 12:13:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007364621 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 09 12:13:15.084522 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:15.085036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:15.087686 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:15.093421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.093905 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.094377 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.095565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.096014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.096434 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.123552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:13:15.200847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5fecb205-c9d2-4f37-a228-178d17738247 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "DELETE /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 204 len: 0 microversion: 2.1 time: 0.119621 Sep 09 12:13:15.201424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 360/734] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:13:15 2022] DELETE /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:13:15.210244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:15.210974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:15.212898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:15.218773 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.219254 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.219690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.220928 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:15.221383 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:15.221806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:15.359316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:15.367675 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-859d11b6-4968-406c-89d4-ba3217a36b94 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1508 microversion: 2.1 time: 0.161999 Sep 09 12:13:15.368233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 375/735] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:15 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:16.390233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:16.390989 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:16.397340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.397819 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.398282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.398968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.399421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.399839 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.418916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:16.592975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:16.601924 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-60c5e529-1d4e-4d99-ba65-a75165c6cf6f tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1508 microversion: 2.1 time: 0.215830 Sep 09 12:13:16.602532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 361/736] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:16 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:16.742665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e4bd59ad-df83-44f1-b093-144aed5ec008 req-6c4e88af-56a0-4bfe-9097-d573bc658b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e64b8c4-2489-4e97-89d1-d32f50da6e2c", "name": "network-vif-deleted", "tag": "6642f427-f0da-4a1e-a58e-affddb81059d"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:16.753482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e4bd59ad-df83-44f1-b093-144aed5ec008 req-6c4e88af-56a0-4bfe-9097-d573bc658b73 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:16.754039 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e4bd59ad-df83-44f1-b093-144aed5ec008 req-6c4e88af-56a0-4bfe-9097-d573bc658b73 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:16.754563 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e4bd59ad-df83-44f1-b093-144aed5ec008 req-6c4e88af-56a0-4bfe-9097-d573bc658b73 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:16.767856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e4bd59ad-df83-44f1-b093-144aed5ec008 req-6c4e88af-56a0-4bfe-9097-d573bc658b73 service nova] Creating event network-vif-deleted:6642f427-f0da-4a1e-a58e-affddb81059d for instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c on hv-cinder-85221 Sep 09 12:13:16.773901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e4bd59ad-df83-44f1-b093-144aed5ec008 req-6c4e88af-56a0-4bfe-9097-d573bc658b73 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035130 Sep 09 12:13:16.775506 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 376/737] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:17.625029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:17.625708 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:17.633047 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.633570 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.634062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.634960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.635465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.635934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.667908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:17.668386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:17.668819 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:17.669255 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lazy-loading 'fault' on Instance uuid 7e64b8c4-2489-4e97-89d1-d32f50da6e2c {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:13:17.711431 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:17.719517 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-46c8b21c-9f4a-4bec-ad26-5f18ace1c7ab tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 200 len: 1311 microversion: 2.1 time: 0.098272 Sep 09 12:13:17.720123 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 362/738] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:17 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:18.742543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:18.743245 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: 7e64b8c4-2489-4e97-89d1-d32f50da6e2c] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:18.750233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.750724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.752001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.752696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.753155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.753582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.767407 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] HTTP exception thrown: Instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c could not be found. Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Request method failure captured: Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c HTTP/1.1 Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyw6FWacK_GcSBnmrWuFi4XbfuxIBxobdXnovNrmDXUPO89-OOKUtMPcGhwLEunsRbOLc5glqqdYvnHa3lHfDej0gumsCdYFKI4kUxiL9PXiwD4fE6yC1FhtPRIlP7d97bkJx3cccrs9BGQfM-hX_PmRdSDFpob4bC5QmaybY-i91SE Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:13:18.769022 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9860574ff3947e3bc61a76e6883107a"}]}] Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9c0f1bfeb1464f87a7f3ea4add940861 Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c could not be found. Sep 09 12:13:18.770639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '7e64b8c4-2489-4e97-89d1-d32f50da6e2c'} Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c could not be found. Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:13:18.771543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c could not be found. Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c could not be found. Sep 09 12:13:18.773093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:18.774412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Returning 404 to user: Instance 7e64b8c4-2489-4e97-89d1-d32f50da6e2c could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:13:18.774412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb4d541e-b571-4415-a164-cad28c46ce97 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c" status: 404 len: 111 microversion: 2.1 time: 0.032174 Sep 09 12:13:18.774412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 377/739] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:18 2022] GET /compute/v2.1/servers/7e64b8c4-2489-4e97-89d1-d32f50da6e2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:13:18.779067 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:18.779606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:18.786101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.786616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.787054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.787748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.788203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.788628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.816004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:13:18.893250 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-be2e28e6-9979-409c-b313-9f0c296612e8 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 204 len: 0 microversion: 2.1 time: 0.117654 Sep 09 12:13:18.894052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 363/740] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:13:18 2022] DELETE /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:13:18.902013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:18.902784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:18.909852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.910377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.910820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:18.911518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:18.911980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:18.912406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:19.041079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:19.044621 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:19.049762 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d5092dbe-33ac-42dd-b2b6-bc3e5538c8fa tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.151816 Sep 09 12:13:19.050351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 378/741] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:18 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:20.074217 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:20.074922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:20.081735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:20.082250 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:20.082691 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:20.083382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:20.083847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:20.084274 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:20.220519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:20.228584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-13713346-4074-4243-9087-ade4422a7108 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.158726 Sep 09 12:13:20.229153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 364/742] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:20 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:21.251687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:21.252258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:21.259199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.259684 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.260118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.260811 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.261267 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.261690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:21.635908 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0f1bfeb1464f87a7f3ea4add940861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9860574ff3947e3bc61a76e6883107a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:21.643836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9206a380-c16f-4719-bc00-630a787e9ef3 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 200 len: 1522 microversion: 2.1 time: 0.396077 Sep 09 12:13:21.644501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 379/743] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:21 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:21.975436 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f916455f-9477-4f45-a3ee-a0d094a87aaf req-06c883f4-30f4-44ef-b0d9-9cbeaad7e202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58b3ed3-4531-4074-9b0d-f23702ea7732", "name": "network-vif-deleted", "tag": "ffea4dad-960c-42da-9277-9d5cf1331ade"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:21.988132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f916455f-9477-4f45-a3ee-a0d094a87aaf req-06c883f4-30f4-44ef-b0d9-9cbeaad7e202 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:21.988440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f916455f-9477-4f45-a3ee-a0d094a87aaf req-06c883f4-30f4-44ef-b0d9-9cbeaad7e202 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:21.988873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f916455f-9477-4f45-a3ee-a0d094a87aaf req-06c883f4-30f4-44ef-b0d9-9cbeaad7e202 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.001298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f916455f-9477-4f45-a3ee-a0d094a87aaf req-06c883f4-30f4-44ef-b0d9-9cbeaad7e202 service nova] Creating event network-vif-deleted:ffea4dad-960c-42da-9277-9d5cf1331ade for instance f58b3ed3-4531-4074-9b0d-f23702ea7732 on hv-cinder-85221 Sep 09 12:13:22.010229 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f916455f-9477-4f45-a3ee-a0d094a87aaf req-06c883f4-30f4-44ef-b0d9-9cbeaad7e202 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038299 Sep 09 12:13:22.010838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 365/744] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:13:22.666009 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:22.666677 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] [instance: f58b3ed3-4531-4074-9b0d-f23702ea7732] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:22.673201 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.673713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.674161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.674851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:22.675296 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:22.675713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:22.690033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] HTTP exception thrown: Instance f58b3ed3-4531-4074-9b0d-f23702ea7732 could not be found. Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Request method failure captured: Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 HTTP/1.1 Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyw6FWacK_GcSBnmrWuFi4XbfuxIBxobdXnovNrmDXUPO89-OOKUtMPcGhwLEunsRbOLc5glqqdYvnHa3lHfDej0gumsCdYFKI4kUxiL9PXiwD4fE6yC1FhtPRIlP7d97bkJx3cccrs9BGQfM-hX_PmRdSDFpob4bC5QmaybY-i91SE Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:13:22.691583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c9860574ff3947e3bc61a76e6883107a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c9860574ff3947e3bc61a76e6883107a"}]}] Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: c9860574ff3947e3bc61a76e6883107a Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1070687503 Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9c0f1bfeb1464f87a7f3ea4add940861 Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1070687503-project Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance f58b3ed3-4531-4074-9b0d-f23702ea7732 could not be found. Sep 09 12:13:22.694177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': 'f58b3ed3-4531-4074-9b0d-f23702ea7732'} Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f58b3ed3-4531-4074-9b0d-f23702ea7732 could not be found. Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:13:22.695661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f58b3ed3-4531-4074-9b0d-f23702ea7732 could not be found. Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f58b3ed3-4531-4074-9b0d-f23702ea7732 could not be found. Sep 09 12:13:22.698179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:13:22.700581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] Returning 404 to user: Instance f58b3ed3-4531-4074-9b0d-f23702ea7732 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:13:22.700581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e111b3d6-14a5-43ce-aa33-99421e862539 tempest-ServerRescueNegativeTestJSON-1070687503 tempest-ServerRescueNegativeTestJSON-1070687503-project] 10.222.0.62 "GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732" status: 404 len: 111 microversion: 2.1 time: 0.030931 Sep 09 12:13:22.700581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 380/745] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:22 2022] GET /compute/v2.1/servers/f58b3ed3-4531-4074-9b0d-f23702ea7732 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:13:26.525838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:26.528081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:26.534659 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.535144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.535578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.536293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.536724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.537139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.567995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bcfef88-0d8b-4361-91c4-c09d87b61012 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047524 Sep 09 12:13:26.568802 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 366/746] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:13:26 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:13:26.637742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:26.638629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:26.644981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.645467 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.645900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.646632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.647087 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.647514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.674462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:13:26.762370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-430bdcfa-be5d-47c3-9b5d-a3e955e0409d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 204 len: 0 microversion: 2.1 time: 0.128218 Sep 09 12:13:26.762952 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 381/747] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:13:26 2022] DELETE /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:13:26.771229 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:26.772188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:26.778716 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.779206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.779638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.780337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:26.780792 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:26.781215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:26.937014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:26.945210 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9e10abc6-5ba5-423b-8704-7fae5a6ee17c tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1672 microversion: 2.1 time: 0.177710 Sep 09 12:13:26.945825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 367/748] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:26 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:27.969899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:27.971111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:27.978473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.978971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.979415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:27.980138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:27.980613 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:27.981042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:28.122777 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:28.131348 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f62f7a44-b1b0-47ca-a84b-feaaaa286333 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1672 microversion: 2.1 time: 0.165513 Sep 09 12:13:28.132329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 382/749] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:27 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:29.158667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:29.160178 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:29.170694 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.171190 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.171831 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.172918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.173455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.174148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.447126 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:29.459801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a4066eed-33da-4e06-8a7c-800c54d0df6f req-f5a6917e-44e4-4475-b7b8-9c178b8781ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00de6121-bfa1-4888-af77-69a8f8800324", "name": "network-vif-deleted", "tag": "fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:29.468519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8357704d-b8bf-4d54-ba17-13561943d565 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 200 len: 1605 microversion: 2.1 time: 0.312885 Sep 09 12:13:29.472222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 368/750] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:29 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 1605 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:29.476714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a4066eed-33da-4e06-8a7c-800c54d0df6f req-f5a6917e-44e4-4475-b7b8-9c178b8781ee service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:29.477392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a4066eed-33da-4e06-8a7c-800c54d0df6f req-f5a6917e-44e4-4475-b7b8-9c178b8781ee service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:29.477823 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a4066eed-33da-4e06-8a7c-800c54d0df6f req-f5a6917e-44e4-4475-b7b8-9c178b8781ee service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:29.490910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a4066eed-33da-4e06-8a7c-800c54d0df6f req-f5a6917e-44e4-4475-b7b8-9c178b8781ee service nova] Creating event network-vif-deleted:fc8cb416-3fe8-4bff-b7cd-c4ef1b01d632 for instance 00de6121-bfa1-4888-af77-69a8f8800324 on hv-cinder-85221 Sep 09 12:13:29.496701 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a4066eed-33da-4e06-8a7c-800c54d0df6f req-f5a6917e-44e4-4475-b7b8-9c178b8781ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041260 Sep 09 12:13:29.498046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 383/751] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:30.495158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:30.496001 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:30.503071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:30.503555 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:30.503979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:30.504665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:30.505114 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:30.505566 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:30.519127 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] HTTP exception thrown: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Request method failure captured: Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 HTTP/1.1 Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxGRp8zUfZKxgEORoJVguGVTw7rk0QjbKx3lRBBLm-XfIry5RaOS-l9IZpMH4zZr9AVi52DmMZ8b1xrkqjwrSrPOA8KUJxWdUC8-ihKt09GW1SHzBXJTexSGZ5UJmtnJvwFSm-TTsNT8HUuneKcdueRR-FLXkDphH7AN_Jhzd3GeU4 Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:13:30.520768 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0475d5537c6f4116ac0905e90153bbc7"}]}] Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: bfc29d15a7344754aa53d55379e2751f Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:13:30.522440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '00de6121-bfa1-4888-af77-69a8f8800324'} Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:13:30.523371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:13:30.524736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:13:30.526372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Returning 404 to user: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:13:30.526372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-30b3fc2a-138a-4ead-b295-6d0acab78b8e tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 404 len: 111 microversion: 2.1 time: 0.031154 Sep 09 12:13:30.526372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 369/752] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:30 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:13:30.532307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1860beff-7f39-4b33-afa7-f97ca6fb18e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '.version_select at 0x7ff2d91b6a60>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:30.551718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1860beff-7f39-4b33-afa7-f97ca6fb18e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794773310" status: 202 len: 0 microversion: 2.1 time: 0.024023 Sep 09 12:13:30.552298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 384/753] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 9 12:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1794773310 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:13:31.281704 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3471607e-ccf9-4fa1-b02b-e8bd72821b56 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'create', calling method: .version_select at 0x7ff2d91df1f0>, body: {"keypair": {"name": "tempest-keypair-1728380854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/D11c81aumKKDHu/tw44tgGmJiLuCTGLJmcP9T4eLy3eia7AZC88I0S62RVYV96BQW4SjliLhwLvVXkdVVkvFe9H0TvmiVZUnHelWVzL09mU+taXkDs4+tlbgqm5d+Rg=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:31.299621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-3471607e-ccf9-4fa1-b02b-e8bd72821b56 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:31.303655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-3471607e-ccf9-4fa1-b02b-e8bd72821b56 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for user bfc29d15a7344754aa53d55379e2751f and project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:31.326262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3471607e-ccf9-4fa1-b02b-e8bd72821b56 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053670 Sep 09 12:13:31.326863 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 370/754] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:13:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:32.691850 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1007180090", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b586704-fa10-4a98-8c4c-8e20e534d239"}], "security_groups": [{"name": "tempest-securitygroup--1816486104"}], "key_name": "tempest-keypair-1728380854", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:32.801671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] validate_networks() for [('6b586704-fa10-4a98-8c4c-8e20e534d239', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:13:33.209726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:13:33.210319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:13:33.210849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:13:33.211518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:13:33.212001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:13:33.222189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:33.222686 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:33.223280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.224030 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:33.224521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:33.224948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:33.244569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:13:33.249301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Getting quotas for user bfc29d15a7344754aa53d55379e2751f and project 0475d5537c6f4116ac0905e90153bbc7. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:13:33.262858 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:13:33.265589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:13:33.320298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6f4e098b-e34b-4629-b153-64a3c7909a52 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.633848 Sep 09 12:13:33.321992 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 385/755] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:13:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:13:33.335776 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e3fb7db-fcd7-480d-a4df-8d60f17ee21a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:33.337546 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e3fb7db-fcd7-480d-a4df-8d60f17ee21a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:33.405701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e3fb7db-fcd7-480d-a4df-8d60f17ee21a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:33.414339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e3fb7db-fcd7-480d-a4df-8d60f17ee21a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1238 microversion: 2.1 time: 0.085122 Sep 09 12:13:33.415056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 371/756] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:33 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:34.438215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:34.439414 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:34.447116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.447607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.448084 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.449031 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:34.449576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:34.450002 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:34.536034 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:34.550448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b539ba62-f866-496a-a0aa-9df078176267 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1298 microversion: 2.1 time: 0.113968 Sep 09 12:13:34.552042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 386/757] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:34 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1298 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:35.575159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:35.575774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:35.583474 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:35.584192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:35.584805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:35.585514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:35.586374 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:35.586974 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:35.804563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:35.814579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c6ff4ee9-103a-49ee-80fc-34469bdbf09d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.242357 Sep 09 12:13:35.816256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 372/758] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:35 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:36.206635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-ceb99f5a-10e5-4ef8-8bd7-6e9231397c58 req-354bbef5-01fc-4cdd-b49a-212cc0225397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2652d36-5242-4ac9-8cee-b0447df90997", "tag": "d726253f-6a62-4681-8866-18ccb0f25453"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:36.217900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ceb99f5a-10e5-4ef8-8bd7-6e9231397c58 req-354bbef5-01fc-4cdd-b49a-212cc0225397 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.218651 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ceb99f5a-10e5-4ef8-8bd7-6e9231397c58 req-354bbef5-01fc-4cdd-b49a-212cc0225397 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.219077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-ceb99f5a-10e5-4ef8-8bd7-6e9231397c58 req-354bbef5-01fc-4cdd-b49a-212cc0225397 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.232309 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-ceb99f5a-10e5-4ef8-8bd7-6e9231397c58 req-354bbef5-01fc-4cdd-b49a-212cc0225397 service nova] Creating event network-changed:d726253f-6a62-4681-8866-18ccb0f25453 for instance c2652d36-5242-4ac9-8cee-b0447df90997 on hv-cinder-85221 Sep 09 12:13:36.238903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-ceb99f5a-10e5-4ef8-8bd7-6e9231397c58 req-354bbef5-01fc-4cdd-b49a-212cc0225397 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040169 Sep 09 12:13:36.240062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 387/759] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:36.838487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:36.839127 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:36.845971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.846518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.847249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.848386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:36.849175 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:36.849788 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:36.978423 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:36.986155 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4c328fb1-a176-46cf-8c4d-74dfc83d2b92 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.151430 Sep 09 12:13:36.986720 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 373/760] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:36 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:38.010217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:38.010941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:38.017785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:38.018301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:38.018740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:38.019428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:38.019883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:38.020316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:38.149582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:38.157844 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-765d99c7-bccb-4e02-97f5-52f598e8bfec tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.151795 Sep 09 12:13:38.158494 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 388/761] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:38 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:13:39.180680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:39.181321 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:39.188199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:39.188748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:39.189185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:39.189878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:39.190580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:39.191156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:39.417723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:39.425310 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-90fc0b2e-8f04-401f-a164-57cbe6738836 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.248590 Sep 09 12:13:39.425866 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 374/762] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:39 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:40.448487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:40.449692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:40.455634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.456116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.456544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.457227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:40.457673 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:40.458089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:40.597167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:40.605760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-18bbadf5-ec9c-44fe-b22a-5d783fc75cf2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.161258 Sep 09 12:13:40.606311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 389/763] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:40 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:41.629443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:41.630058 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:41.636999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.637509 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.637952 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.638682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:41.639140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:41.639845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:41.774677 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:41.785266 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-564bb8fe-357e-4601-92da-d6d9f2c4ce87 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.160165 Sep 09 12:13:41.786518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 375/764] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:41 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:42.809548 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:42.810201 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:42.817014 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:42.817487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:42.817909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:42.818614 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:42.819061 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:42.819477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:42.952554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:42.960881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6cc055e7-127d-43b6-a7fa-95f893bb4624 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.155323 Sep 09 12:13:42.961440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 390/765] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:42 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:43.530850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-10d0e540-19f6-4de3-8e4f-c5feb73698b1 req-5fe5a665-55d7-4197-bdb5-6434b5cbf998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2652d36-5242-4ac9-8cee-b0447df90997", "name": "network-vif-plugged", "status": "completed", "tag": "d726253f-6a62-4681-8866-18ccb0f25453"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:43.539635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:43.549062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-10d0e540-19f6-4de3-8e4f-c5feb73698b1 req-5fe5a665-55d7-4197-bdb5-6434b5cbf998 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.549062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-10d0e540-19f6-4de3-8e4f-c5feb73698b1 req-5fe5a665-55d7-4197-bdb5-6434b5cbf998 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.549062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-10d0e540-19f6-4de3-8e4f-c5feb73698b1 req-5fe5a665-55d7-4197-bdb5-6434b5cbf998 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.560679 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-10d0e540-19f6-4de3-8e4f-c5feb73698b1 req-5fe5a665-55d7-4197-bdb5-6434b5cbf998 service nova] Creating event network-vif-plugged:d726253f-6a62-4681-8866-18ccb0f25453 for instance c2652d36-5242-4ac9-8cee-b0447df90997 on hv-cinder-85221 Sep 09 12:13:43.565826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-10d0e540-19f6-4de3-8e4f-c5feb73698b1 req-5fe5a665-55d7-4197-bdb5-6434b5cbf998 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038524 Sep 09 12:13:43.566848 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 376/766] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:13:43.984182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:43.984735 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:43.986686 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:43.987362 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:43.993906 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.994877 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.995319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:43.996015 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:43.996470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:43.996894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:44.125756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:44.133325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-93db2e61-e961-4382-a1ed-13a400438cac tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.153161 Sep 09 12:13:44.133882 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 391/767] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:43 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:45.158141 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:45.158833 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:45.161202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:45.166609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:45.167089 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:45.167518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:45.168203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:45.168654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:45.169074 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:45.301312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:45.309004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b1bcc834-19b1-47c4-bf09-554410fba5b9 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1364 microversion: 2.1 time: 0.155682 Sep 09 12:13:45.309568 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 377/768] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:45 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:46.332004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:46.332619 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:46.335995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:46.354745 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.355317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.355782 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.356508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.356956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.357373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.486286 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:13:46.494287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f5f66e53-82a6-462c-99ca-ef9afbb894ee tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1549 microversion: 2.1 time: 0.166297 Sep 09 12:13:46.494862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 392/769] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:13:46 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:13:46.517621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:13:46.518161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:13:46.524405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.524888 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.525390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.526015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:46.526494 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:46.526915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:46.530440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:13:46.607938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7a4c4bda-6fa7-4f00-a054-dfa054216e9f tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094858 Sep 09 12:13:46.608569 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 378/770] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:13:46 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:13:47.544377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-01848c14-1dc7-4832-96e0-a7b877b38063 req-2feee1bc-b9a5-4697-8c89-134015df9265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2652d36-5242-4ac9-8cee-b0447df90997", "tag": "d726253f-6a62-4681-8866-18ccb0f25453"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:13:47.555263 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01848c14-1dc7-4832-96e0-a7b877b38063 req-2feee1bc-b9a5-4697-8c89-134015df9265 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:13:47.555752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01848c14-1dc7-4832-96e0-a7b877b38063 req-2feee1bc-b9a5-4697-8c89-134015df9265 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:13:47.556182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-01848c14-1dc7-4832-96e0-a7b877b38063 req-2feee1bc-b9a5-4697-8c89-134015df9265 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:13:47.570519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-01848c14-1dc7-4832-96e0-a7b877b38063 req-2feee1bc-b9a5-4697-8c89-134015df9265 service nova] Creating event network-changed:d726253f-6a62-4681-8866-18ccb0f25453 for instance c2652d36-5242-4ac9-8cee-b0447df90997 on hv-cinder-85221 Sep 09 12:13:47.577051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-01848c14-1dc7-4832-96e0-a7b877b38063 req-2feee1bc-b9a5-4697-8c89-134015df9265 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Sep 09 12:13:47.577674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 393/771] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:12.355833 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:12.356557 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:12.361469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:12.361985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:12.368663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:12.369406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:12.369846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:12.370567 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:12.371019 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:12.371447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:12.394753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c203aff2-240f-47c9-b447-9f0ab64c4902 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/ips" status: 200 len: 149 microversion: 2.1 time: 0.040312 Sep 09 12:14:12.395322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 379/772] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:14:12 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:15.838799 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:15.840004 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:15.845546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "127edc66-b22c-45c9-9125-50307e4fbbbc"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:15.847977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:15.856316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:15.856815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:15.857254 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:15.857951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:15.858442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:15.859496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:16.136622 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4f6569f7-9254-44a0-ae6e-a3163c7f19a3 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299582 Sep 09 12:14:16.137332 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 394/773] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:14:15 2022] POST /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:24.753591 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "127edc66-b22c-45c9-9125-50307e4fbbbc"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:24.755971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:24.757948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:24.758615 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:24.767038 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.767767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.768273 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:24.769117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.769691 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.770192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:24.853051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Invalid volume: volume 127edc66-b22c-45c9-9125-50307e4fbbbc is already attached to instances: 45fc4606-72de-4cf6-842b-58f6a51f0f12 Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: POST /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments HTTP/1.1 Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 74 Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:14:24.854805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {"volumeAttachment": {"volumeId": "127edc66-b22c-45c9-9125-50307e4fbbbc"}} Sep 09 12:14:24.856491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Invalid volume: volume 127edc66-b22c-45c9-9125-50307e4fbbbc is already attached to instances: 45fc4606-72de-4cf6-842b-58f6a51f0f12 Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'server_id': '45fc4606-72de-4cf6-842b-58f6a51f0f12', 'body': {'volumeAttachment': {'volumeId': '127edc66-b22c-45c9-9125-50307e4fbbbc'}}} Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 127edc66-b22c-45c9-9125-50307e4fbbbc is already attached to instances: 45fc4606-72de-4cf6-842b-58f6a51f0f12 Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:24.857371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 127edc66-b22c-45c9-9125-50307e4fbbbc is already attached to instances: 45fc4606-72de-4cf6-842b-58f6a51f0f12 Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:24.858887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 127edc66-b22c-45c9-9125-50307e4fbbbc is already attached to instances: 45fc4606-72de-4cf6-842b-58f6a51f0f12 Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 400 to user: Invalid volume: volume 127edc66-b22c-45c9-9125-50307e4fbbbc is already attached to instances: 45fc4606-72de-4cf6-842b-58f6a51f0f12 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5e2e3535-4c4e-4c52-9bb4-b05d35eadbcb tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107404 Sep 09 12:14:24.860498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 380/774] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:14:24 2022] POST /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:14:24.927454 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:24.928035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:24.934229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.934713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.935147 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:24.935829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:24.936278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:24.936699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:25.025174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lazy-loading 'services' on Instance uuid 45fc4606-72de-4cf6-842b-58f6a51f0f12 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:14:25.104217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-92fef7f1-9221-4e9b-ad92-fb59b69a4c2e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments/127edc66-b22c-45c9-9125-50307e4fbbbc" status: 202 len: 0 microversion: 2.1 time: 0.181393 Sep 09 12:14:25.105192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 395/775] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:14:24 2022] DELETE /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments/127edc66-b22c-45c9-9125-50307e4fbbbc => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:14:25.114147 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:25.116409 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:25.123035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:25.123527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:25.123970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:25.125386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:25.125386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:25.126328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:25.162422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-afd9ea8f-f6db-41ff-9f63-51ffbcf88a84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052604 Sep 09 12:14:25.163016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 381/776] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:14:25 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:26.176217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:26.178639 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:26.185533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.186017 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.186481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.187178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.187634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.188601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.219058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-36cfdafa-c28f-4a09-b384-b77c4ce4f5ea tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047190 Sep 09 12:14:26.219838 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 396/777] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:14:26 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 09 12:14:26.285123 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:26.285713 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:26.292095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.292586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.293042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.293736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.295233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.295233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.321628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:14:26.401955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1f932f9b-a88e-4570-9784-cfe67a12c6fd tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 204 len: 0 microversion: 2.1 time: 0.120371 Sep 09 12:14:26.402571 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 382/778] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:14:26 2022] DELETE /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:14:26.415127 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:26.415127 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:26.422960 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.423453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.423892 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.424633 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:26.425092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:26.425517 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:26.561856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:26.570515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e5bcfc86-a368-45ad-b3d7-b390e7355f6f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1680 microversion: 2.1 time: 0.163331 Sep 09 12:14:26.571092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 397/779] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:26 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:27.594963 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:27.595651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:27.601985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:27.602492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:27.602919 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:27.603603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:27.604049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:27.604499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:27.739820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:27.747986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69652865-6405-4fc9-b660-282d825b9046 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1680 microversion: 2.1 time: 0.157803 Sep 09 12:14:27.748561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 383/780] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:27 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:28.772231 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:28.772834 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:28.779349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:28.779822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:28.780249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:28.780934 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:28.781384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:28.781795 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:28.921803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:28.929853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-04d35fe5-a9fe-4ecb-ac26-bb1ce7bfdcba tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1680 microversion: 2.1 time: 0.161474 Sep 09 12:14:28.930456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 398/781] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:28 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:14:29.518758 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f5489c9d-0769-4297-b625-d47a3d149c1f req-cad54397-653b-488c-a603-b8fddc7e6051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fc4606-72de-4cf6-842b-58f6a51f0f12", "name": "network-vif-deleted", "tag": "65247ac2-80ca-4fab-a247-ddd3cd753758"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:29.530796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f5489c9d-0769-4297-b625-d47a3d149c1f req-cad54397-653b-488c-a603-b8fddc7e6051 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.531403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f5489c9d-0769-4297-b625-d47a3d149c1f req-cad54397-653b-488c-a603-b8fddc7e6051 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.531829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f5489c9d-0769-4297-b625-d47a3d149c1f req-cad54397-653b-488c-a603-b8fddc7e6051 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:29.544155 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f5489c9d-0769-4297-b625-d47a3d149c1f req-cad54397-653b-488c-a603-b8fddc7e6051 service nova] Creating event network-vif-deleted:65247ac2-80ca-4fab-a247-ddd3cd753758 for instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 on hv-cinder-85221 Sep 09 12:14:29.548840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f5489c9d-0769-4297-b625-d47a3d149c1f req-cad54397-653b-488c-a603-b8fddc7e6051 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034316 Sep 09 12:14:29.549442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 384/782] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:29.952662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:29.953644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:29.961023 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.961580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.962020 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:29.962752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:29.963243 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:29.963677 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:30.003869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:30.004358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:30.004792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:30.005241 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lazy-loading 'fault' on Instance uuid 45fc4606-72de-4cf6-842b-58f6a51f0f12 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:14:30.057461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:30.065661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2cd5af46-cf96-4adb-af4e-31716d5e2edf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 200 len: 1331 microversion: 2.1 time: 0.116739 Sep 09 12:14:30.066362 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 399/783] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:29 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:31.089907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:31.090628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:31.096720 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:31.097192 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:31.097626 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:31.098340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:31.098789 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:31.099209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:31.112507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 HTTP/1.1 Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:14:31.114104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:14:31.115710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '45fc4606-72de-4cf6-842b-58f6a51f0f12'} Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:14:31.117328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:14:31.119082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:14:31.120413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:14:31.120413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b0ffc112-6680-4faa-90fd-92fb2f2a7376 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 404 len: 111 microversion: 2.1 time: 0.030251 Sep 09 12:14:31.120413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 385/784] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:31 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:14:31.124588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8dd57440-ad95-4814-8b8f-8de16dd8cff8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '.version_select at 0x7ff2d92ddca0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:31.143388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8dd57440-ad95-4814-8b8f-8de16dd8cff8 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081182348" status: 202 len: 0 microversion: 2.1 time: 0.022643 Sep 09 12:14:31.143953 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 400/785] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 9 12:14:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1081182348 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:14:31.745528 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4fdfc77f-eda4-489c-adae-c2a330a054f4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: .version_select at 0x7ff2d930d9d0>, body: {"keypair": {"name": "tempest-keypair-673706027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+3bSav1GvjJJnUXRi6TTYN44XUNpOkieDQxXzUxuGpNjUip1VIJK0gRMsj9PFY+YBgjiZboRntdxXh8uuplo/zrZhdX90PtJGOupRFwX4PuSBA/G790WYuoH+KUVAi3g=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:31.763681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-4fdfc77f-eda4-489c-adae-c2a330a054f4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:14:31.768508 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-4fdfc77f-eda4-489c-adae-c2a330a054f4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:14:31.800543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4fdfc77f-eda4-489c-adae-c2a330a054f4 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059146 Sep 09 12:14:31.801263 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 386/786] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:14:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:14:33.087976 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2084927557", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f846b424-a53d-4e1e-9d8f-617b0d2b2566"}], "security_groups": [{"name": "tempest-securitygroup--1023347126"}], "key_name": "tempest-keypair-673706027", "user_data": "}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:33.190708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] validate_networks() for [('f846b424-a53d-4e1e-9d8f-617b0d2b2566', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:14:33.553010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:14:33.553438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:14:33.553925 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:14:33.554366 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:14:33.554807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:14:33.564042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:33.564537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:33.564995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:33.565708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:33.566210 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:33.566720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:33.586487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:14:33.590630 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Getting quotas for user 16c99b5db9794dff83ea1b67fd238655 and project 51e38a10fcf8400394897df5f65428b0. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:14:33.603314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:14:33.605669 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:14:33.653164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b172bf69-ebf8-4f91-b177-703129c98e17 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569800 Sep 09 12:14:33.653726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 401/787] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:14:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:14:33.666234 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b88ce150-e8d2-4efd-92da-41cad26b7748 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:33.666846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b88ce150-e8d2-4efd-92da-41cad26b7748 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:33.723565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b88ce150-e8d2-4efd-92da-41cad26b7748 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:33.730382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b88ce150-e8d2-4efd-92da-41cad26b7748 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1241 microversion: 2.1 time: 0.068410 Sep 09 12:14:33.730948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 387/788] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:33 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:34.754935 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:34.755674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:34.761904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:34.762423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:34.762921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:34.763609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:34.764253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:34.764706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:34.838470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:34.847496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08ec263c-6369-4192-8670-fb7604f428d6 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1301 microversion: 2.1 time: 0.097817 Sep 09 12:14:34.848078 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 402/789] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:34 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:35.871425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:35.872036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:35.879006 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:35.879761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:35.880202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:35.880918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:35.881381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:35.881804 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:36.100307 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:36.108054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5910da5a-febd-4faa-b831-e1f76c1aadbf tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.240755 Sep 09 12:14:36.108808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 388/790] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:35 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:36.358775 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-6020557b-2c95-4f42-9987-be69c8f19788 req-82e2f6a6-f1ed-4702-a700-2db2daba2de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c98f12d-98d4-4f46-a1b5-a0b7735f6755", "tag": "7e5ba6d3-ae76-45b3-8d33-397c36a7ae50"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:36.369167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6020557b-2c95-4f42-9987-be69c8f19788 req-82e2f6a6-f1ed-4702-a700-2db2daba2de1 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:36.369644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6020557b-2c95-4f42-9987-be69c8f19788 req-82e2f6a6-f1ed-4702-a700-2db2daba2de1 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:36.370074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-6020557b-2c95-4f42-9987-be69c8f19788 req-82e2f6a6-f1ed-4702-a700-2db2daba2de1 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:36.382826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-6020557b-2c95-4f42-9987-be69c8f19788 req-82e2f6a6-f1ed-4702-a700-2db2daba2de1 service nova] Creating event network-changed:7e5ba6d3-ae76-45b3-8d33-397c36a7ae50 for instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 on hv-cinder-85221 Sep 09 12:14:36.387715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-6020557b-2c95-4f42-9987-be69c8f19788 req-82e2f6a6-f1ed-4702-a700-2db2daba2de1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033294 Sep 09 12:14:36.388497 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 403/791] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:14:37.131800 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:37.132370 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:37.138655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:37.139133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:37.139565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:37.140254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:37.140699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:37.141122 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:37.275764 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:37.283774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9590511b-693f-47df-a5d7-cb7cf7c28d74 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.155852 Sep 09 12:14:37.284353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 389/792] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:37 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:38.253864 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:38.254500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:38.261037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:38.261524 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:38.262035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:38.263138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:38.263761 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:38.264183 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:38.290087 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-419aad95-06a3-4431-96c2-f08c9de066db tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/ips" status: 200 len: 151 microversion: 2.20 time: 0.041421 Sep 09 12:14:38.290693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 404/793] 10.222.0.62 () {60 vars in 1289 bytes} [Fri Sep 9 12:14:38 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:14:38.305631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:38.306278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:38.312774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:38.313831 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:38.314332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:38.315026 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:38.315480 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:38.315904 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:38.455592 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:38.464436 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bcb23dd-059a-4b42-bb65-f1d466c99d1f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.162514 Sep 09 12:14:38.470159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 390/794] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:38 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:39.489018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:39.489580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:39.496307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:39.496784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:39.497216 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:39.497900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:39.498373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:39.498798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:39.630428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:39.638257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bf025156-d9b3-4ee5-85f6-840f45f0731f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.153135 Sep 09 12:14:39.638814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 405/795] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:39 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:40.662662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:40.663278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:40.669855 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.670368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.670805 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.671491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:40.671982 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:40.673099 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:40.802224 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:40.809908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a1af2e9a-cf71-442a-bd99-c8bb9daaaf8a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.151128 Sep 09 12:14:40.810515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 391/796] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:40 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:41.177681 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:41.178315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:41.184749 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.185263 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.185696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.186419 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.186877 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.187303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.211345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lazy-loading 'flavor' on Instance uuid a483ee57-2187-4440-8e0d-10a5fedec303 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:14:41.399585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-14fbc120-2f9a-40b5-9b61-6a91bf87dc15 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/action" status: 202 len: 0 microversion: 2.20 time: 0.225677 Sep 09 12:14:41.403284 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 406/797] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 9 12:14:41 2022] POST /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:14:41.408459 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:41.409066 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:41.416110 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.416628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.417060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.417833 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.418390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.418899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.552349 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:41.560329 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:41.561778 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:41.563563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bdbf26c6-0142-422a-8d54-03ebef5b0c6d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.158526 Sep 09 12:14:41.564126 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 392/798] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:41 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:14:41.833698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:41.834422 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:41.841089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.841569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.842000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.842752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:41.843203 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:41.843631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:41.974833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:41.982539 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21234015-35ca-412f-bc1f-41025832668d tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.153603 Sep 09 12:14:41.983105 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 407/799] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:41 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:42.588854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:42.589490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:42.596090 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:42.596574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:42.597012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:42.597722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:42.598229 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:42.598650 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:42.729281 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:42.738268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:42.739701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:42.740853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e827fbd7-2437-4fdb-9c33-3605655c814b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.155963 Sep 09 12:14:42.741406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 393/800] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:42 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:14:43.005187 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:43.005717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:43.012230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.012724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.013165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.013901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.014369 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.014794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.148148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:43.151709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:43.157420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de4e2881-2cc1-4830-b985-ace98c750849 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.155586 Sep 09 12:14:43.157993 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 408/801] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:43 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:43.773088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:43.773706 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:43.776188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:43.781937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.782660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.783290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.784201 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.784669 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.785096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.818465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f7a1603c-afd2-41d9-84b4-cf4671bb2153 req-747d7a9c-5cf5-4e63-859f-ec09e781f423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c98f12d-98d4-4f46-a1b5-a0b7735f6755", "name": "network-vif-plugged", "status": "completed", "tag": "7e5ba6d3-ae76-45b3-8d33-397c36a7ae50"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:43.828476 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:43.829441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:43.831768 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7a1603c-afd2-41d9-84b4-cf4671bb2153 req-747d7a9c-5cf5-4e63-859f-ec09e781f423 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:43.832578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7a1603c-afd2-41d9-84b4-cf4671bb2153 req-747d7a9c-5cf5-4e63-859f-ec09e781f423 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:43.833674 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f7a1603c-afd2-41d9-84b4-cf4671bb2153 req-747d7a9c-5cf5-4e63-859f-ec09e781f423 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:43.851039 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f7a1603c-afd2-41d9-84b4-cf4671bb2153 req-747d7a9c-5cf5-4e63-859f-ec09e781f423 service nova] Creating event network-vif-plugged:7e5ba6d3-ae76-45b3-8d33-397c36a7ae50 for instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 on hv-cinder-85221 Sep 09 12:14:43.858096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f7a1603c-afd2-41d9-84b4-cf4671bb2153 req-747d7a9c-5cf5-4e63-859f-ec09e781f423 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043082 Sep 09 12:14:43.859396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 409/802] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:43.930565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:43.939386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:43.941179 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:43.942425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-568e41bb-3eaf-4fb1-b3ca-48f30d500700 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.173796 Sep 09 12:14:43.942960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 394/803] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:43 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:44.181967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:44.182733 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:44.190164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.190655 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.191097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:44.191802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.192262 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.192691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:44.325070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:44.333499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5f3c64fd-e12c-44cc-89d3-2619d8d1a464 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.156255 Sep 09 12:14:44.334075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 410/804] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:44 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:44.968048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:44.968656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:44.975902 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.976379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.976826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:44.977487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:44.977937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:44.978383 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:45.104437 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:45.112935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:45.114381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:45.115564 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5c72f562-f242-49ec-a053-536a5ac8a43d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.151406 Sep 09 12:14:45.116115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 395/805] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:44 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:45.356165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:45.356780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:45.364065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:45.364552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:45.365225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:45.365925 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:45.366478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:45.366904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:45.514408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:45.523221 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb389397-1011-4b6d-976b-4ad4521b9796 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1367 microversion: 2.1 time: 0.170532 Sep 09 12:14:45.523372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 411/806] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:45 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:46.140796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:46.141452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:46.148043 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.148533 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.148966 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.149664 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.150145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.150575 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.281033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:46.289117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:46.290665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:46.291923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e402f76-3f0c-459d-be7f-9c0d84e69deb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.155109 Sep 09 12:14:46.292514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 396/807] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:46 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:46.546149 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:46.546770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:46.550921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:46.554602 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.555090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.555540 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.556239 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.556694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.557117 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.694360 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:46.702134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dc0a7e9d-e07d-4929-937a-b63cfbbf5e18 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1556 microversion: 2.1 time: 0.159745 Sep 09 12:14:46.702712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 412/808] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:14:46 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:14:46.724903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:46.725389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:46.731319 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.731797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.732258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:46.732936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:46.733386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:46.733802 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:47.049619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7af776a9-de93-438b-a05b-eaa84aaa7be9 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.328542 Sep 09 12:14:47.050293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 397/809] 10.222.0.62 () {58 vars in 1275 bytes} [Fri Sep 9 12:14:46 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:47.316875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:47.317480 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:47.323594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:47.324071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:47.324496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:47.325181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:47.325626 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:47.326040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:47.455573 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:47.466609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:47.469773 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:47.471851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-89eaed7f-90ed-4c8a-9f21-14aed6041a76 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.158682 Sep 09 12:14:47.472523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 413/810] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:47 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:48.035015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-4368e39f-1d7d-493f-8ca7-4575ffd49da4 req-b8924207-28e9-40c5-9f0d-52ee748a52b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c98f12d-98d4-4f46-a1b5-a0b7735f6755", "tag": "7e5ba6d3-ae76-45b3-8d33-397c36a7ae50"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:48.049256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4368e39f-1d7d-493f-8ca7-4575ffd49da4 req-b8924207-28e9-40c5-9f0d-52ee748a52b4 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:48.050018 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4368e39f-1d7d-493f-8ca7-4575ffd49da4 req-b8924207-28e9-40c5-9f0d-52ee748a52b4 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:48.050584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-4368e39f-1d7d-493f-8ca7-4575ffd49da4 req-b8924207-28e9-40c5-9f0d-52ee748a52b4 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:48.064458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-4368e39f-1d7d-493f-8ca7-4575ffd49da4 req-b8924207-28e9-40c5-9f0d-52ee748a52b4 service nova] Creating event network-changed:7e5ba6d3-ae76-45b3-8d33-397c36a7ae50 for instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 on hv-cinder-85221 Sep 09 12:14:48.069485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-4368e39f-1d7d-493f-8ca7-4575ffd49da4 req-b8924207-28e9-40c5-9f0d-52ee748a52b4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038963 Sep 09 12:14:48.070418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 398/811] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:14:48.501697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:48.502927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:48.509754 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:48.510272 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:48.510772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:48.511711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:48.512166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:48.512781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:48.652788 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:48.661850 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:48.663427 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:48.664755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-897a56c6-e345-43a2-bc5a-30807f9294d2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.167659 Sep 09 12:14:48.665417 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 414/812] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:48 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:14:49.690350 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:49.691222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:49.698106 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:49.698624 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:49.699372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:49.699762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:49.700291 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:49.700911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:49.705955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:49.847587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:49.855660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:49.857087 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:49.858257 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-394974ff-310f-4e32-93b5-85cca278549f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.173175 Sep 09 12:14:49.858817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 399/813] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:49 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:50.884668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:50.885335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:50.892336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:50.892821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:50.893258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:50.893952 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:50.894443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:50.894889 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:51.025369 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:51.033878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:51.035354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:51.036554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9613a313-4b88-4918-998c-c1cc7c01235f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.155845 Sep 09 12:14:51.037111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 415/814] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:50 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:52.061095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:52.061775 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:52.070966 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:52.071727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:52.072157 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:52.073054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:52.073506 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:52.074161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:52.209407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:52.217921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:52.219943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:52.221150 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d86fa5f5-33da-4362-a05c-3814720d79a5 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.164311 Sep 09 12:14:52.221899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 400/815] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:52 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:53.246618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:53.247227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:53.253697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:53.254217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:53.255089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:53.255344 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:53.255801 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:53.256219 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:53.388279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:53.397868 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:53.399396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:53.400558 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7e1ee5a6-415d-418a-bc2b-c9152df88829 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1743 microversion: 2.20 time: 0.158077 Sep 09 12:14:53.401120 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 416/816] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:53 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:54.427482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:54.428096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:54.434595 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:54.435084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:54.435525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:54.436221 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:54.436684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:54.437112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:54.574644 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:54.582815 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:54.584239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:54.585380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cf0f9a8a-c02b-4c85-b985-66ed3f70bef7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1743 microversion: 2.20 time: 0.161978 Sep 09 12:14:54.585921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 401/817] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:54 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:14:55.610057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:55.610686 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:55.617189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:55.617663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:55.618092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:55.619055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:55.619504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:55.619921 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:55.774603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:55.784687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:55.786141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:55.787339 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-91417bc8-d201-426c-9d0d-d45a861e31d9 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1743 microversion: 2.20 time: 0.181200 Sep 09 12:14:55.788111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 417/818] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:55 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:56.813534 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:56.814238 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:56.816676 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:14:56.822034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:56.822401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:56.822836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:56.823532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:56.823987 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:56.824406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:56.971680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:56.980038 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:56.981646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:56.983107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-58d1759a-f9bf-450e-925a-5a92337c994f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1743 microversion: 2.20 time: 0.174167 Sep 09 12:14:56.983678 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 402/819] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:56 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:57.807980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-39615856-5462-44ab-a437-1972d27d1af4 req-7f942032-239a-40c8-8003-755852823ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a483ee57-2187-4440-8e0d-10a5fedec303", "name": "network-vif-plugged", "status": "completed", "tag": "77b9c61a-9f4b-48fb-a52b-6900d4ee0b57"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:14:57.819189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39615856-5462-44ab-a437-1972d27d1af4 req-7f942032-239a-40c8-8003-755852823ef6 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:57.819708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39615856-5462-44ab-a437-1972d27d1af4 req-7f942032-239a-40c8-8003-755852823ef6 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:57.820460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-39615856-5462-44ab-a437-1972d27d1af4 req-7f942032-239a-40c8-8003-755852823ef6 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:57.835454 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-39615856-5462-44ab-a437-1972d27d1af4 req-7f942032-239a-40c8-8003-755852823ef6 service nova] Creating event network-vif-plugged:77b9c61a-9f4b-48fb-a52b-6900d4ee0b57 for instance a483ee57-2187-4440-8e0d-10a5fedec303 on hv-cinder-85221 Sep 09 12:14:57.840994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-39615856-5462-44ab-a437-1972d27d1af4 req-7f942032-239a-40c8-8003-755852823ef6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036727 Sep 09 12:14:57.841628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 418/820] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:14:58.010072 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:58.010614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:58.017860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:58.018386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:58.018838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:58.019549 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:58.020012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:58.020437 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:58.170046 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:58.178574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:58.180020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:58.181188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95687be1-0c91-4a81-9362-eda0df03a010 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1743 microversion: 2.20 time: 0.175119 Sep 09 12:14:58.181750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 403/821] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:58 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:14:59.208470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:14:59.209252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:14:59.216973 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:59.217656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:59.218835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:59.220135 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:14:59.220849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:14:59.221375 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:14:59.366323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:59.375027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:59.376566 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:14:59.377855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1286442-2ac1-4980-a109-5abbe954d268 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.174371 Sep 09 12:14:59.378595 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 419/822] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:14:59 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:00.405093 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:00.407112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:00.416766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.417744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.418904 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.420114 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:00.420815 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:00.421973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:00.580842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:00.591764 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:00.593727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:00.595152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e46e86ec-7f8b-4bb9-a0b3-b119467a4a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.194971 Sep 09 12:15:00.595709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 404/823] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:00 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:01.621083 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:01.622400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:01.632595 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:01.633358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:01.634624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:01.635737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:01.636423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:01.637045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:01.846474 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:01.856889 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:01.858646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:01.860683 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-77a64aa5-1df3-4333-9217-17b46d417c1d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.243831 Sep 09 12:15:01.861322 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 420/824] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:01 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:02.892519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:02.893356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:02.905133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.907326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.908712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:02.910223 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:02.910941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:02.911663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:03.085716 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:03.094637 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:03.096565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:03.098052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4836d46-288c-49ee-97b1-be55a693da52 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.214494 Sep 09 12:15:03.098891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 405/825] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:02 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:04.124299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:04.125168 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:04.135057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:04.135803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:04.136875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:04.138357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:04.139232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:04.141035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:04.426937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:04.435981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:04.441508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:04.443052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63da6a11-2b57-41c0-80e5-c840b07ab136 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.322776 Sep 09 12:15:04.443860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 421/826] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:04 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:05.469681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:05.470258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:05.489873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:05.490408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:05.490852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:05.491563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:05.492028 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:05.492453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:05.859439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:05.876166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:05.891353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:05.893127 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5dd66f59-050a-4820-b6cd-55f9af5c395b tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.428084 Sep 09 12:15:05.894491 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 406/827] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:05 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:06.924646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:06.925430 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:06.936652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:06.937480 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:06.938251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:06.939153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:06.939772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:06.940816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:07.214840 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:07.228461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:07.231286 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:07.234281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9e6cc511-dd9a-43c1-a485-d48d6ad8d735 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.313421 Sep 09 12:15:07.235991 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 422/828] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:06 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:08.283686 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:08.286217 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:08.302893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:08.303371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:08.303845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:08.304543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:08.305158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:08.305578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:08.512402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:08.524606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:08.527181 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:08.529185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7b6fccd7-991a-4edb-9bd7-5482d1affe7e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.263884 Sep 09 12:15:08.530292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 407/829] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:08 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:09.560092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:09.560699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:09.577792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:09.580399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:09.581045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:09.582781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:09.584453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:09.585070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:09.910682 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:09.920872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:09.922896 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:09.928543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8fc30b99-aca3-4b52-bd09-19606423f5a2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.368472 Sep 09 12:15:09.929376 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 423/830] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:09 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:10.956267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:10.956955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:10.966675 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:10.967166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:10.967598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:10.968864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:10.969326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:10.969754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:11.213769 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:11.238788 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:11.243829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:11.255047 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7c56b719-b7c2-4cc9-978e-c9f886044af7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.297480 Sep 09 12:15:11.257942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 408/831] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:10 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:12.283509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:12.284126 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:12.295209 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:12.298467 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:12.299166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:12.303463 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:12.304222 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:12.304880 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:12.644656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:12.653827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:12.660106 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:12.663504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7a04dd7-1f20-4f1c-982f-defbba495b55 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.384479 Sep 09 12:15:12.664953 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 424/832] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:12 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:13.694451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:13.695313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:13.703677 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:13.704280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:13.705312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:13.706437 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:13.706888 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:13.707396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:13.923921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:13.935939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:13.948713 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:13.950231 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7f081a1f-ba3a-4199-8c03-4b7b585b18f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1738 microversion: 2.20 time: 0.261015 Sep 09 12:15:13.951326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 409/833] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:13 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:14.978798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:14.980429 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:14.987583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.988334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.988773 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:14.990144 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:14.991658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:14.992268 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:15.029276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=89 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:15.194028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.203678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.208446 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:15.210330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ad5b759-0e58-4b9d-85e5-5e392373017c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1720 microversion: 2.20 time: 0.235803 Sep 09 12:15:15.212313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 425/834] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:14 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1720 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:16.237951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:16.238895 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:16.246483 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.247347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.247957 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:16.249090 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:16.249837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:16.250459 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:16.416649 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:16.426031 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:16.428499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:16.429899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-40926443-843c-4cf6-aa2c-9dccce8f9000 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1720 microversion: 2.20 time: 0.195987 Sep 09 12:15:16.445698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 410/835] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:16 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:17.214146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:17.215345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:17.227319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:17.232567 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.233716 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.234270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.235217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.235887 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.236530 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.262602 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8c7c51f9-6f10-4753-bc7a-02f62f41ccab tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/ips" status: 200 len: 143 microversion: 2.1 time: 0.052367 Sep 09 12:15:17.270180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 426/836] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:15:17 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/ips => generated 143 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:17.456432 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:17.457024 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:17.466020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.466539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.466978 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.472329 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.473038 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.473479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.711707 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.724119 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.725724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:17.726942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-50497304-c421-4e0d-b305-3b9419df8d64 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1663 microversion: 2.20 time: 0.274870 Sep 09 12:15:17.729507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 411/837] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:17 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1663 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:17.761232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00c04732-a5f5-4fe3-b8f9-11d01cca5624"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:17.763601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:17.775755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.776570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.778473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.782792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.784229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.784581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:17.985919 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b840711d-6f10-445a-9877-812ff6a6521d req-f89ac216-721c-4425-b6c8-1e179b9b34c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a483ee57-2187-4440-8e0d-10a5fedec303", "name": "network-vif-unplugged", "status": "completed", "tag": "77b9c61a-9f4b-48fb-a52b-6900d4ee0b57"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:17.996527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b840711d-6f10-445a-9877-812ff6a6521d req-f89ac216-721c-4425-b6c8-1e179b9b34c6 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:17.997296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b840711d-6f10-445a-9877-812ff6a6521d req-f89ac216-721c-4425-b6c8-1e179b9b34c6 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:17.998054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b840711d-6f10-445a-9877-812ff6a6521d req-f89ac216-721c-4425-b6c8-1e179b9b34c6 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.114752 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.compute.server_external_events [req-b840711d-6f10-445a-9877-812ff6a6521d req-f89ac216-721c-4425-b6c8-1e179b9b34c6 service nova] Unable to find a host for instance a483ee57-2187-4440-8e0d-10a5fedec303. Dropping event network-vif-unplugged {{(pid=120719) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 09 12:15:18.114752 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b840711d-6f10-445a-9877-812ff6a6521d req-f89ac216-721c-4425-b6c8-1e179b9b34c6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.132771 Sep 09 12:15:18.115574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 412/838] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 134 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 09 12:15:18.350667 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02c17f63-d0aa-4ec0-a725-d39471b9b56c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.593216 Sep 09 12:15:18.351514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 427/839] 10.222.0.62 () {62 vars in 1364 bytes} [Fri Sep 9 12:15:17 2022] POST /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-volume_attachments => generated 188 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 09 12:15:18.510313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:18.511478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:18.518426 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.519177 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.519794 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.520705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.521338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.521766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.792706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "470e2d7e-ce85-4bf6-a876-cde4eadf427b"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:18.796512 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:18.807723 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.808228 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.808671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.809388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:18.809847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:18.810313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:18.900125 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d7f6555d-15c8-49c3-b795-275d3280e5a4 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-volume_attachments/00c04732-a5f5-4fe3-b8f9-11d01cca5624" status: 202 len: 0 microversion: 2.20 time: 0.393706 Sep 09 12:15:18.904440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 413/840] 10.222.0.62 () {60 vars in 1457 bytes} [Fri Sep 9 12:15:18 2022] DELETE /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-volume_attachments/00c04732-a5f5-4fe3-b8f9-11d01cca5624 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:15:19.022082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:19.034405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:19.055344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:19.056292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:19.056747 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:19.059624 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:19.062396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:19.062880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:19.138510 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:19.191968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120719) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 12:15:19.293524 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca2cf7cf-bb73-46ab-86c6-206fd6f44f18 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505138 Sep 09 12:15:19.294521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 428/841] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:15:18 2022] POST /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:15:19.349490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [a6e7a17c-c130-445f-bc0f-6dd988a26485] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 12:15:20.358212 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [a6e7a17c-c130-445f-bc0f-6dd988a26485] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 33786. Sep 09 12:15:20.367810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc147db3-6bcb-4c92-bfef-c753c8026983 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "POST /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/action" status: 202 len: 0 microversion: 2.20 time: 1.356106 Sep 09 12:15:20.374150 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 414/842] 10.222.0.62 () {62 vars in 1319 bytes} [Fri Sep 9 12:15:19 2022] POST /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/action => generated 0 bytes in 1358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:15:20.378592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:20.379349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:20.391101 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.391895 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.393764 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.395047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:20.395724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:20.396286 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:20.554988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.565589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.567036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:20.568217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8ca14e64-d0b7-462d-a767-e0788e388d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1671 microversion: 2.20 time: 0.195065 Sep 09 12:15:20.569675 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 429/843] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:20 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1671 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:21.605281 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:21.607620 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:21.623225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.627288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.657185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.661214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:21.661912 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:21.662542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:21.852240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.864574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.867619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:21.869335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-64c00498-4c3a-45bf-9d37-9b61a4df6d96 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1671 microversion: 2.20 time: 0.275842 Sep 09 12:15:21.877249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 415/844] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:21 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1671 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:22.897112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:22.898853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:22.906949 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:22.907820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:22.908496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:22.909583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:22.910324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:22.911313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:23.057462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:23.067572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:23.069494 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:23.070936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6a7c0573-9deb-487d-89d7-af5ca4ebace7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.178027 Sep 09 12:15:23.071759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 430/845] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:22 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:24.112061 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:24.113592 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:24.121426 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.122352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.123019 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:24.124461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:24.125120 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:24.125748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:24.307442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:24.322750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:24.324919 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:24.326273 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d867baf0-9bc7-478a-96fe-865594716478 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.223858 Sep 09 12:15:24.327782 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 416/846] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:24 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:25.353580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:25.355128 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:25.363840 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:25.364335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:25.364964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:25.365680 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:25.366150 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:25.366582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:25.537617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.547471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.549462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:25.551015 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2ec7189b-43ee-41a2-9ad0-d3b36005df95 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.202714 Sep 09 12:15:25.552086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 431/847] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:25 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:25.766496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bce969ae-e83b-46af-be8e-b57b9bf73e8e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Action: 'create', calling method: .version_select at 0x7ff2d90efdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1030988953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ6exrArhDFkbj3BD5Wkt8itmlUnSeqmrC6nfdrl2kQouVjt5IVdk3umD6UOlumFr6rSLxkFe2z4/4150AkeVXQQn0ygDcXIdudZaM/Jx5L8Dt6TtGwd3bpxbGUvQ2rvtA=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:25.783641 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-bce969ae-e83b-46af-be8e-b57b9bf73e8e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Getting quotas for project 68a3919f2172442fa280c380a7bff271. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:15:25.788610 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-bce969ae-e83b-46af-be8e-b57b9bf73e8e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Getting quotas for user cb72d25947724d028d948292925258d9 and project 68a3919f2172442fa280c380a7bff271. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:15:25.814042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bce969ae-e83b-46af-be8e-b57b9bf73e8e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048898 Sep 09 12:15:25.816615 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 417/848] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:15:25 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:25.871048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2076755635", "imageRef": "45e0b858-8dd1-450d-87fb-27878b0188d4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1030988953", "networks": [{"uuid": "92e3c792-44ee-4374-b1a7-f751d3ee00aa"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:25.932177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] validate_networks() for [('92e3c792-44ee-4374-b1a7-f751d3ee00aa', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:15:26.365157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:15:26.365802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:15:26.366279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:15:26.366782 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:15:26.367394 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:15:26.377815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.378388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.378893 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.379624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.380077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.380500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.397328 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Getting quotas for project 68a3919f2172442fa280c380a7bff271. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:15:26.401670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Getting quotas for user cb72d25947724d028d948292925258d9 and project 68a3919f2172442fa280c380a7bff271. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:15:26.413186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:15:26.415483 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='45e0b858-8dd1-450d-87fb-27878b0188d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:15:26.468164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f9839332-93dd-46a9-af63-77b50692d8e5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601338 Sep 09 12:15:26.475808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 432/849] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:15:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:15:26.481576 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-49320d50-145f-4495-928e-dbeee9993613 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:26.482275 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-49320d50-145f-4495-928e-dbeee9993613 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:26.550185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-49320d50-145f-4495-928e-dbeee9993613 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:26.558044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-49320d50-145f-4495-928e-dbeee9993613 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1259 microversion: 2.1 time: 0.081533 Sep 09 12:15:26.559567 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 418/850] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:26 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1259 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:26.581549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:26.582267 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:26.589037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.589656 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.594837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.595856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:26.597023 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:26.597661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:26.785542 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:26.797116 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:26.799881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:26.801714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce9b7d2f-5ac1-4468-93b0-74a676ad45f7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.224175 Sep 09 12:15:26.802372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 433/851] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:26 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:27.583841 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:27.584465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:27.587098 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:27.594423 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.595079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.595595 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.596320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.596795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.597209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.673016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:27.681631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-00abd8ab-fcee-4f79-9777-c9311484dc64 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.101608 Sep 09 12:15:27.682396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 419/852] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:27 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:27.829928 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:27.830640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:27.837533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.837902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.838370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.839086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:27.839544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:27.839974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:27.999110 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.007700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.009121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.010541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08d37715-e92d-458b-bce7-54af161237e7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.184574 Sep 09 12:15:28.011093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 434/853] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:27 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:28.706022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:28.707109 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:28.713835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.714364 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.714810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.715512 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:28.715969 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:28.716389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:28.791698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:28.800162 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e8e19f92-57e6-47cc-bbba-55fabf35db4d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.098965 Sep 09 12:15:28.800777 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 420/854] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:28 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:29.036459 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:29.037051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:29.043624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.044122 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.044553 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.045325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.046016 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.046620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.251742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.261789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.263649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.265597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4bb59c48-5f32-473d-8728-582f3e0a179d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.233250 Sep 09 12:15:29.274525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 435/855] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:29 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:29.823465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:29.824081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:29.831559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.832329 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.832940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.833842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:29.834510 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:29.834942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:29.899042 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:29.907716 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-74e0537e-99c2-41e3-ad7c-5f4f99ca54ff tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.088191 Sep 09 12:15:29.918169 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 421/856] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:29 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:30.293454 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:30.294742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:30.301986 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.302787 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.303387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.304263 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.304711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.305132 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.472856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.481349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.483668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:30.484918 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bea0d85a-c8da-4f54-bcaf-cb29f52bc0b3 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.196083 Sep 09 12:15:30.491355 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 436/857] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:30 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:30.931011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:30.931617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:30.938036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.938541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.938972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:30.939770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:30.940286 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:30.940703 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.007599 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:31.019274 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-aa55a857-4aed-4386-9397-598b82cb90a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.091478 Sep 09 12:15:31.019634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 422/858] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:30 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:31.510275 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:31.510956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:31.517365 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.517850 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.518327 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.519000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:31.519452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:31.519872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:31.665071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:31.674724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:31.676147 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:31.677295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b016e4c0-ef8a-46b1-8e8b-7cccf52d429a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.170996 Sep 09 12:15:31.677854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 437/859] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:31 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:32.042536 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:32.043612 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:32.052939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:32.053438 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:32.053887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:32.054668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:32.055141 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:32.055582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:32.130399 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.138194 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6e44985f-438e-4967-81b2-b8d38fe3ac9d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.101101 Sep 09 12:15:32.138901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 423/860] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:32 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:32.703837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:32.704423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:32.710869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:32.711357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:32.711791 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:32.712480 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:32.712935 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:32.713359 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:32.850490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.852798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:32.861418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.862839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:32.864003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bfaae25e-e08a-4df9-9fdb-640397d334f0 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.164788 Sep 09 12:15:32.864559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 438/861] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:32 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:33.161298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:33.161918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:33.168792 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.169349 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.169823 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.171242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.171705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.172134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.231925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:33.240068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e0d788c3-747a-4dc7-bc3c-58983444ba22 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.082729 Sep 09 12:15:33.240632 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 424/862] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:33 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:33.891455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:33.892040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:33.899946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.900429 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.900861 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:33.901598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:33.902005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:33.902888 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:34.034571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.042540 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.043958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.045099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25da37db-f44d-49df-befb-07eb78a82174 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.158096 Sep 09 12:15:34.045659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 439/863] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:33 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:34.264688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:34.265306 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:34.271764 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:34.272243 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:34.272680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:34.273369 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:34.273826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:34.274292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:34.333887 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:34.341832 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5a8a863-6019-4200-af0f-28312853b8e8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.081635 Sep 09 12:15:34.342447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 425/864] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:34 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:35.070468 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:35.071024 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:35.077411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.077886 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.078363 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.079029 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.079640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.080065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.214507 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:35.223540 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:35.224954 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:35.226145 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a75377f3-8526-4862-8b1f-2d2b26e64ceb tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.159708 Sep 09 12:15:35.226785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 440/865] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:35 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:35.364323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:35.364936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:35.371655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.372138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.372574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.373265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:35.373721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:35.374175 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:35.436794 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:35.444667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0f88b3ee-4601-4797-9c96-84479e8806db tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1263 microversion: 2.1 time: 0.084192 Sep 09 12:15:35.445248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 426/866] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:35 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:36.252384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:36.252983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:36.259422 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.259931 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.260357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.261038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.261484 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.261900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.388393 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:36.398252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.406608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.408025 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.409162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1c54089f-65fb-4cd5-8cb0-e2cf8527dfee tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.161672 Sep 09 12:15:36.409711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 441/867] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:36 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:36.467445 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:36.468055 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:36.474971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.475455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.475938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.476573 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:36.477027 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:36.477454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:36.541211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:36.549595 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c2a7a42-9f32-491f-a284-12eb9588d387 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1255 microversion: 2.1 time: 0.085982 Sep 09 12:15:36.550188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 427/868] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:36 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1255 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:37.433743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:37.434373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:37.436211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:37.442454 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.442926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.443349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.444043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.444495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.444940 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.572985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:37.573735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:37.576622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:37.576822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.581405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.581891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.582356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.583060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:37.583518 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:37.583947 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:37.585587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.587154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.588302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c482d208-6f88-493f-ab65-6dfcdc6a1e47 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.158438 Sep 09 12:15:37.588863 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 442/869] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:37 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:37.646298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:37.653936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e3802f61-11c7-4996-b1fb-824cc1bce6d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1255 microversion: 2.1 time: 0.084801 Sep 09 12:15:37.654756 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 428/870] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:37 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1255 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:38.614568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:38.616338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:38.623623 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.624335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.625313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.626024 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.626772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.626923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.677282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:38.677908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:38.684536 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.685029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.685477 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.686214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.686676 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.687141 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.766586 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.776327 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.777856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:38.779150 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a1dd0603-393e-45fd-9ff7-a2a5f3c84647 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.170301 Sep 09 12:15:38.780202 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 443/871] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:38 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:38.898640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:38.900926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:38.919805 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.920385 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.920891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.921648 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.922108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.922732 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.955517 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c8d15256-a9c1-4201-841c-71c3200fd043 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060822 Sep 09 12:15:38.956388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 444/872] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:15:38 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:15:38.967166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:38.967662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:38.974715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.975211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.975647 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:38.976351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:38.976807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:38.977227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.002785 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:39.012358 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cc3ce7cf-3c23-4484-807b-c026912be276 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1311 microversion: 2.1 time: 0.338763 Sep 09 12:15:39.014365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 429/873] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:38 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1311 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:39.016154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-28911286-b3b2-41d9-8c50-ca3c053e60a3 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/470e2d7e-ce85-4bf6-a876-cde4eadf427b" status: 200 len: 194 microversion: 2.1 time: 0.052813 Sep 09 12:15:39.021827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 445/874] 10.222.0.62 () {58 vars in 1413 bytes} [Fri Sep 9 12:15:38 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/470e2d7e-ce85-4bf6-a876-cde4eadf427b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:15:39.807478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:39.808099 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:39.815503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.816276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.816885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:39.817766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:39.818413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:39.819007 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.009906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:40.020220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:40.022009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:40.023550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-373cd55d-20bf-446c-8e3c-6b9f80327d7c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.221219 Sep 09 12:15:40.036897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:40.038225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:40.046482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 430/875] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:39 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:40.048752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.051279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.055185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.056177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.056814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.057417 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.276411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:40.284759 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3026d0af-9c34-4217-bc0e-b83ed21ac466 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.251753 Sep 09 12:15:40.285339 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 446/876] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:40 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:40.412993 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54849c26-694a-486c-a5c9-360f60b2430a"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:40.415503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:40.422901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.423667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.424855 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.425799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:40.426455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:40.427046 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:40.505375 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:41.053425 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:41.054783 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:41.061510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:41.062518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:41.062948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:41.063636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:41.064084 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:41.064556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:41.202179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.210725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.212161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.213334 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b750bdc6-2249-4210-a933-919b4e25e27d tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.163977 Sep 09 12:15:41.213899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 447/877] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:41 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:41.309163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:41.310059 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:41.318152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:41.319280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:41.320092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:41.321495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:41.322268 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:41.322988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:41.470769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:41.479821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-419e8342-5121-4655-af58-055114dbf92f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.175547 Sep 09 12:15:41.480406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 448/878] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:41 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:42.176250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-e8f95dd4-6bff-4d14-b8d3-b556bd2a198e req-e489e069-3d86-4631-ae2d-963d3ecd4c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a483ee57-2187-4440-8e0d-10a5fedec303", "name": "network-vif-plugged", "status": "completed", "tag": "77b9c61a-9f4b-48fb-a52b-6900d4ee0b57"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:42.188660 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8f95dd4-6bff-4d14-b8d3-b556bd2a198e req-e489e069-3d86-4631-ae2d-963d3ecd4c0b service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.189392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8f95dd4-6bff-4d14-b8d3-b556bd2a198e req-e489e069-3d86-4631-ae2d-963d3ecd4c0b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.191402 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-e8f95dd4-6bff-4d14-b8d3-b556bd2a198e req-e489e069-3d86-4631-ae2d-963d3ecd4c0b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.202072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-e8f95dd4-6bff-4d14-b8d3-b556bd2a198e req-e489e069-3d86-4631-ae2d-963d3ecd4c0b service nova] Creating event network-vif-plugged:77b9c61a-9f4b-48fb-a52b-6900d4ee0b57 for instance a483ee57-2187-4440-8e0d-10a5fedec303 on hv-cinder-85221 Sep 09 12:15:42.208556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-e8f95dd4-6bff-4d14-b8d3-b556bd2a198e req-e489e069-3d86-4631-ae2d-963d3ecd4c0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036454 Sep 09 12:15:42.209756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 449/879] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:15:42.246235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:42.247748 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:42.263379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.263988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.264368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.265815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.266314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.266740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.415225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:42.426452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:42.427899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:42.429108 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-85bb4f99-6eb7-4818-a951-01b6b1999a8e tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.188811 Sep 09 12:15:42.429664 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 450/880] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:42 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:42.504017 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:42.504927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:42.511200 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.511690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.512130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.512835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:42.513294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:42.513720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:42.647618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:42.657521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ecb3e73e-8035-4e14-853f-af952a73798a tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.157765 Sep 09 12:15:42.658594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 451/881] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:42 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:43.456314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:43.457011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:43.463885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:43.464473 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:43.464985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:43.465896 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:43.466372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:43.466982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:43.613670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.622738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.624242 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.625409 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-403dd53c-25c7-4528-81ae-10d83a86a3bc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.173491 Sep 09 12:15:43.626181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 452/882] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:43 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:43.681847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:43.683335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:43.695440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:43.695943 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:43.696381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:43.697085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:43.697541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:43.697967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:43.856089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:43.864014 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7a03d78a-9a15-49e8-b527-36af1e5d91ca tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.186313 Sep 09 12:15:43.864585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 453/883] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:43 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:44.651418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:44.652183 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:44.659259 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:44.659748 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:44.660285 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:44.660926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:44.661374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:44.661842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:44.820515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:44.830013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:44.831519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:44.832652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3ce453eb-3f86-40fb-b671-8154c65bf985 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.185296 Sep 09 12:15:44.833404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 454/884] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:44 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:44.887652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:44.888587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:44.896345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:44.897111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:44.897609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:44.898294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:44.898753 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:44.899180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:45.034237 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:45.042049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-589994c8-c4ba-4087-85a8-975f8aa28cf2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.158348 Sep 09 12:15:45.042643 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 455/885] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:44 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:45.859100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:45.859972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:45.867676 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:45.868744 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:45.869389 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:45.870430 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:45.871133 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:45.871760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:45.878049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:46.019293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:46.027766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:46.029223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:46.030937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-781dafd1-9ab2-42d2-9289-05c5f2886e81 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.175704 Sep 09 12:15:46.031498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 456/886] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:45 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:46.065033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:46.065652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:46.071862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.072347 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.072783 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:46.073486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:46.073949 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:46.074401 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:46.212248 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:46.221467 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-58d74c81-892e-4ba9-9a03-be5e13832807 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.160172 Sep 09 12:15:46.222066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 457/887] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:46 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:47.056205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:47.056924 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:47.063493 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:47.063983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:47.064415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:47.065114 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:47.065576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:47.065988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:47.201173 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.210671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.212186 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.213302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9aa1c577-fe7f-40d8-9143-bfef4ab01b21 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.161057 Sep 09 12:15:47.213899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 458/888] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:47 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:47.245851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:47.246607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:47.253910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:47.254535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:47.255049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:47.255833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:47.256354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:47.256846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:47.400504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:47.408847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-82f60031-1e67-4c29-89e1-a2961bbbe6f5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.167620 Sep 09 12:15:47.409667 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 459/889] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:47 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:48.239095 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:48.239741 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:48.242104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:48.247858 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.248346 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.248785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.249484 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.249943 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.250879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.380541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.388641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.390074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.391745 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7cff24dd-5266-448f-ad18-5ab106e220b6 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.156616 Sep 09 12:15:48.392300 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 460/890] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:48 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:48.430945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:48.431553 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:48.437371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.437850 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.438320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.439003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:48.439452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:48.439870 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:48.568021 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:48.575696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6bf23dc4-5931-440e-87d8-97d5e97843b9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.148417 Sep 09 12:15:48.576287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 461/891] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:48 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:49.420763 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:49.421370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:49.428406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.428887 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.429320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:49.430005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.430493 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.430917 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:49.562303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:49.570330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:49.572740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:49.574457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-875c7267-a196-41bf-9bba-a56c31b64857 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.157507 Sep 09 12:15:49.575013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 462/892] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:49 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:49.599269 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:49.600026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:49.606035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.606543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.606981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:49.607663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:49.608114 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:49.608535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:49.736439 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:49.744238 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4086e7b6-48d6-4187-ab19-fb80fb3d79c2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.148713 Sep 09 12:15:49.744802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 463/893] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:49 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:50.423221 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=25 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:50.519936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:50.600280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:50.600925 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:50.607380 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:50.607866 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:50.608303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.608996 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:50.609620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:50.610052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.743481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.751523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.752966 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.754134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7508b312-af9c-49a6-b3bf-08d9427e0d1f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.157840 Sep 09 12:15:50.754703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 464/894] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:50 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:50.766878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:50.767482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:50.773243 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:50.773718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:50.774167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.774847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:50.775301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:50.775718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:50.901361 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:50.909616 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9fc3fb6b-2662-45f9-ba6c-99cb8eb678a0 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.146866 Sep 09 12:15:50.910199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 465/895] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:50 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:15:51.779413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:51.780103 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:51.787356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.787837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.788762 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.788968 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:51.789420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:51.789842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:51.986449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.995478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.997099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:51.998472 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b9fc0e15-c02a-4454-8b07-1d2f83d74f92 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.222969 Sep 09 12:15:52.009823 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 466/896] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:51 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:15:52.014611 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:52.015222 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:52.024604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.025093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.025522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.026250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.026699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.027177 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.113323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05a0075f-9bea-415d-90e7-eb6113e27dad tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "POST /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.704195 Sep 09 12:15:52.115492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 431/897] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:15:40 2022] POST /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments => generated 194 bytes in 11707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:52.510059 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:52.521242 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-af70212a-35a6-438a-ae8b-26a3d5098334 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.510147 Sep 09 12:15:52.522049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 467/898] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:52 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:52.905517 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-13d73f29-98d0-4777-b3a5-203b83be360c req-5d41b726-cddc-4095-9084-b9a36442b74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0badf4d4-3bf8-42ce-889d-90e70dc1b058", "tag": "78ddba5c-300e-4659-8539-78d51f625eb6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:15:52.916135 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-13d73f29-98d0-4777-b3a5-203b83be360c req-5d41b726-cddc-4095-9084-b9a36442b74d service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:52.916452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-13d73f29-98d0-4777-b3a5-203b83be360c req-5d41b726-cddc-4095-9084-b9a36442b74d service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:52.916889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-13d73f29-98d0-4777-b3a5-203b83be360c req-5d41b726-cddc-4095-9084-b9a36442b74d service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:52.928009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-13d73f29-98d0-4777-b3a5-203b83be360c req-5d41b726-cddc-4095-9084-b9a36442b74d service nova] Creating event network-changed:78ddba5c-300e-4659-8539-78d51f625eb6 for instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 on hv-cinder-85221 Sep 09 12:15:52.932923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-13d73f29-98d0-4777-b3a5-203b83be360c req-5d41b726-cddc-4095-9084-b9a36442b74d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Sep 09 12:15:52.933681 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 432/899] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:15:53.023937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:53.024480 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:53.030885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:53.031408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:53.031837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:53.032515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:53.032963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:53.033381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:53.386723 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.394935 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.396357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.397490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3f1b6f2-7abe-4ffc-8258-19e20d83294a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.377545 Sep 09 12:15:53.398052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 468/900] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:53 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:53.544772 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:53.545340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:53.553773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:53.554537 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:53.555157 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:53.556017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:53.556621 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:53.557184 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:53.692158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:53.700834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-89ff5697-2c34-4457-90b9-8fd1222aa0a9 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.160381 Sep 09 12:15:53.701405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 433/901] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:53 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:54.424179 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:54.425345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:54.433263 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.433829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.434309 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.435410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.435763 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.436176 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.605140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.614557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.616008 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.617171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-63f3e334-8248-4b98-a668-0cee361313e2 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1729 microversion: 2.20 time: 0.197971 Sep 09 12:15:54.617712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 469/902] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:54 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:54.724891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:54.726153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:54.732701 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.733184 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.733617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.734942 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:54.735390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:54.735807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:54.867101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:54.875807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c4d8c2f-8068-4b94-946d-9578a004a9a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.154095 Sep 09 12:15:54.875807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 434/903] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:54 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:55.644208 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:55.644853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:55.651391 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.651878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.652314 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:55.653008 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.653466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.653901 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:55.783471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:55.791714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:55.793171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:55.794412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-80be0ba6-bc06-4de9-ae40-cd28a861cf57 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1716 microversion: 2.20 time: 0.154639 Sep 09 12:15:55.795253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 470/904] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:15:55 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:15:55.897004 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:55.897530 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:55.904224 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.904710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.905173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:55.905876 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:55.906372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:55.906847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:56.037472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:56.045824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d62ee7b-4e43-4a1c-a83d-8259e30f9ab7 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.152737 Sep 09 12:15:56.046425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 435/905] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:55 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:57.068538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:57.069087 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:57.076329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:57.076818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:57.077258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:57.077971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:57.078460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:57.078890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:57.207533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:57.215134 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9c85cc13-c461-4fda-a446-22282615d989 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.150530 Sep 09 12:15:57.215702 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 471/906] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:57 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:58.239488 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:58.240142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:58.247929 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:58.248540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:58.248939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:58.250281 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:58.250785 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:58.251248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:58.386764 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:58.394284 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a28b70c1-ffdc-457b-9384-7f64eeffc60c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.158988 Sep 09 12:15:58.394854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 436/907] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:58 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:15:59.417207 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:15:59.417816 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:15:59.424963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:59.425446 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:59.425876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:59.426607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:15:59.427062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:15:59.427487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:15:59.558251 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:15:59.560441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:15:59.567848 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1dbfdb7c-40ad-4c1a-877d-757dd5f9810c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.154434 Sep 09 12:15:59.568620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 472/908] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:15:59 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:00.190145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-91a127d4-ed32-497a-bce5-fc399639ec7d req-21fcc985-4ca8-469e-b4a0-4ebbe5fce0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0badf4d4-3bf8-42ce-889d-90e70dc1b058", "name": "network-vif-plugged", "status": "completed", "tag": "78ddba5c-300e-4659-8539-78d51f625eb6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:00.201054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91a127d4-ed32-497a-bce5-fc399639ec7d req-21fcc985-4ca8-469e-b4a0-4ebbe5fce0ca service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.201547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91a127d4-ed32-497a-bce5-fc399639ec7d req-21fcc985-4ca8-469e-b4a0-4ebbe5fce0ca service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.201981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-91a127d4-ed32-497a-bce5-fc399639ec7d req-21fcc985-4ca8-469e-b4a0-4ebbe5fce0ca service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.214220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-91a127d4-ed32-497a-bce5-fc399639ec7d req-21fcc985-4ca8-469e-b4a0-4ebbe5fce0ca service nova] Creating event network-vif-plugged:78ddba5c-300e-4659-8539-78d51f625eb6 for instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 on hv-cinder-85221 Sep 09 12:16:00.219205 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-91a127d4-ed32-497a-bce5-fc399639ec7d req-21fcc985-4ca8-469e-b4a0-4ebbe5fce0ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033416 Sep 09 12:16:00.220033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 437/909] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:00.591652 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:00.593222 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:00.600891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.601704 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.602410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.603527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.604062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.604751 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.747265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:00.749593 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:00.756401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.756886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.757327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.758063 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.758557 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.758979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.790288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22183870-1786-46a4-b519-65886fad4f3d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047574 Sep 09 12:16:00.790778 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 438/910] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:16:00 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:16:00.803893 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:00.812055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e8a1f799-34b5-4e83-a00b-fc41e674169e tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.224339 Sep 09 12:16:00.813303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 473/911] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:00 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:00.929906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:00.930472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:00.936855 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.937342 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.938369 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.939082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.939541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.939965 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.970365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe4b1a03-56c8-4b06-9280-e2e97fde260b tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/470e2d7e-ce85-4bf6-a876-cde4eadf427b" status: 200 len: 194 microversion: 2.1 time: 0.044445 Sep 09 12:16:00.970940 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 439/912] 10.222.0.62 () {58 vars in 1413 bytes} [Fri Sep 9 12:16:00 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/470e2d7e-ce85-4bf6-a876-cde4eadf427b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:00.981290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:00.981785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:00.987859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.988342 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.988780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:00.989474 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:00.989925 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:00.990374 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:01.073767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lazy-loading 'services' on Instance uuid c2652d36-5242-4ac9-8cee-b0447df90997 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:01.145394 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-051f8016-d143-46c6-8f58-920b754533db tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/470e2d7e-ce85-4bf6-a876-cde4eadf427b" status: 202 len: 0 microversion: 2.1 time: 0.167910 Sep 09 12:16:01.145999 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 474/913] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:16:00 2022] DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/470e2d7e-ce85-4bf6-a876-cde4eadf427b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:01.835799 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:01.836420 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:01.842891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:01.843377 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:01.843817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:01.844505 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:01.844962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:01.846079 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:01.974051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:01.981824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d36be989-9a95-4481-828d-0a08b7d919b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1359 microversion: 2.1 time: 0.149822 Sep 09 12:16:01.982420 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 440/914] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:01 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:03.004852 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:03.005543 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:03.011692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.012162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.012588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.013261 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.013708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.014143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.145826 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:03.153531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7947b559-13b6-429c-a497-00ad25d8f4d5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1548 microversion: 2.1 time: 0.153341 Sep 09 12:16:03.154098 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 475/915] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:02 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:03.176632 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:03.177343 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:03.183878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.184362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.184800 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.185498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.185955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.186416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.331185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:03.338915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e6ef3b2a-2685-4571-84df-59b4ed016783 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1548 microversion: 2.1 time: 0.166731 Sep 09 12:16:03.339486 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 441/916] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:03 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:03.360938 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:03.365739 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:03.366525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Searching by: {'deleted': False, 'project_id': '68a3919f2172442fa280c380a7bff271'} {{(pid=120720) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 09 12:16:03.373279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.373760 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.374226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.375059 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.375442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.375862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.463646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.multi_cell_list [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120720) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 09 12:16:03.561472 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-08712825-4a90-4b2a-b2ed-5b82450f30ce tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204211 Sep 09 12:16:03.562061 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 476/917] 10.222.0.62 () {58 vars in 1125 bytes} [Fri Sep 9 12:16:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:03.573703 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:03.574271 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:03.580793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.581285 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.581761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.582500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:03.582963 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:03.583584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:03.715952 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:03.724400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5945c8fa-fecf-4452-adda-be129c97991b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1548 microversion: 2.1 time: 0.154539 Sep 09 12:16:03.724971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 442/918] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:03 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:04.390011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:04.390552 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:04.397031 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.397516 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.397956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.398675 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.399136 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.399562 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.428812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-20834a7a-be70-459b-9aa7-90cb05000c8a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/54849c26-694a-486c-a5c9-360f60b2430a" status: 200 len: 194 microversion: 2.1 time: 0.042691 Sep 09 12:16:04.429323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 477/919] 10.222.0.62 () {58 vars in 1413 bytes} [Fri Sep 9 12:16:04 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/54849c26-694a-486c-a5c9-360f60b2430a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:04.439837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:04.440354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:04.447071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.447563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.448010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.448724 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:04.449181 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:04.449608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:04.530997 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lazy-loading 'services' on Instance uuid c2652d36-5242-4ac9-8cee-b0447df90997 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:04.601655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6b5d449a-bdd5-41b8-a7b3-5e3ca9d1af1a tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/54849c26-694a-486c-a5c9-360f60b2430a" status: 202 len: 0 microversion: 2.1 time: 0.165610 Sep 09 12:16:04.602279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 443/920] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:16:04 2022] DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments/54849c26-694a-486c-a5c9-360f60b2430a => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:05.276067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7689dfc-d7c9-4286-82ea-ac0f0f9cd052"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:05.278411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:05.284778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.285268 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.285708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:05.286430 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.286887 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.287498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:05.578068 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-99900845-48af-4f70-920a-c33384e39432 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305599 Sep 09 12:16:05.578935 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 478/921] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:16:05 2022] POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:05.783993 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:05.786385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:05.792880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.793369 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.794023 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:05.794758 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.795391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.795888 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:05.826018 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d75db2d3-65e7-40ee-bddd-fa2b97604ff4 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047407 Sep 09 12:16:05.826636 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 444/922] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:16:05 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:16:05.944366 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:05.946779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:05.952967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.953448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.953884 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:05.955317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:05.955818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:05.956280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:05.985077 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1bb92d1e-c0bd-44be-9541-b23cb3de95dd tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046194 Sep 09 12:16:05.985689 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 479/923] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:16:05 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:16:06.051863 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:06.052357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:06.058387 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:06.058882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:06.059323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:06.060014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:06.060472 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:06.060900 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:06.085602 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:16:06.160121 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e489c3c4-a2f7-48da-868e-ebc6444c3a6d tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 204 len: 0 microversion: 2.1 time: 0.112481 Sep 09 12:16:06.160956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 445/924] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:06 2022] DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:16:06.170320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:06.170931 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:06.178131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:06.178779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:06.179289 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:06.180070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:06.180606 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:06.181067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:06.319413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:06.327153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8bf5ef45-9668-44d4-b166-7f6adf671414 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1672 microversion: 2.1 time: 0.161152 Sep 09 12:16:06.327720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 480/925] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:06 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:07.351616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:07.352328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:07.358705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:07.359189 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:07.359627 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:07.360317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:07.361280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:07.361704 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:07.365682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:07.499981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:07.507747 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54e98922-78d8-4b4f-ae82-cf8e5d83b405 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1672 microversion: 2.1 time: 0.160387 Sep 09 12:16:07.508313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 446/926] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:07 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:08.530906 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:08.531507 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:08.537973 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:08.538486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:08.538914 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:08.539599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:08.540045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:08.540460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:08.773767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:08.781581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-73d02576-5735-4398-a320-d8598be96201 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1672 microversion: 2.1 time: 0.254463 Sep 09 12:16:08.782389 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 481/927] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:08 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:09.451348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3711d9d5-75d5-4f1c-b102-7252e813dbe4 req-e63c1757-476b-4278-851f-4a2afb96dcea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2652d36-5242-4ac9-8cee-b0447df90997", "name": "network-vif-deleted", "tag": "d726253f-6a62-4681-8866-18ccb0f25453"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:09.461688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3711d9d5-75d5-4f1c-b102-7252e813dbe4 req-e63c1757-476b-4278-851f-4a2afb96dcea service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:09.462194 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3711d9d5-75d5-4f1c-b102-7252e813dbe4 req-e63c1757-476b-4278-851f-4a2afb96dcea service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:09.462630 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3711d9d5-75d5-4f1c-b102-7252e813dbe4 req-e63c1757-476b-4278-851f-4a2afb96dcea service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:09.476931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3711d9d5-75d5-4f1c-b102-7252e813dbe4 req-e63c1757-476b-4278-851f-4a2afb96dcea service nova] Creating event network-vif-deleted:d726253f-6a62-4681-8866-18ccb0f25453 for instance c2652d36-5242-4ac9-8cee-b0447df90997 on hv-cinder-85221 Sep 09 12:16:09.482318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3711d9d5-75d5-4f1c-b102-7252e813dbe4 req-e63c1757-476b-4278-851f-4a2afb96dcea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Sep 09 12:16:09.483314 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 447/928] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:09.804795 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:09.805533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:09.812120 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:09.812688 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:09.813181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:09.813928 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:09.814509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:09.815605 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:09.852298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:09.852788 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:09.853226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:09.853683 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lazy-loading 'fault' on Instance uuid c2652d36-5242-4ac9-8cee-b0447df90997 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:09.953436 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc29d15a7344754aa53d55379e2751f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0475d5537c6f4116ac0905e90153bbc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:09.962496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f400f0d7-bd50-43ba-bba7-3f78da19b637 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 200 len: 1328 microversion: 2.1 time: 0.161593 Sep 09 12:16:09.963160 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 482/929] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:09 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:10.986546 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:10.987235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:10.993480 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:10.993955 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:10.994530 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:10.995205 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:10.995655 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:10.996091 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:11.008963 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] HTTP exception thrown: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Request method failure captured: Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 HTTP/1.1 Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxGRp8zUfZKxgEORoJVguGVTw7rk0QjbKx3lRBBLm-XfIry5RaOS-l9IZpMH4zZr9AVi52DmMZ8b1xrkqjwrSrPOA8KUJxWdUC8-ihKt09GW1SHzBXJTexSGZ5UJmtnJvwFSm-TTsNT8HUuneKcdueRR-FLXkDphH7AN_Jhzd3GeU4 Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:11.010603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0475d5537c6f4116ac0905e90153bbc7"}]}] Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: bfc29d15a7344754aa53d55379e2751f Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:11.012239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'c2652d36-5242-4ac9-8cee-b0447df90997'} Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:11.013151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:11.014750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:11.016317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Returning 404 to user: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:11.016317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2518f0d8-356d-43d5-bf3d-281d4f5316e2 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 404 len: 111 microversion: 2.1 time: 0.030298 Sep 09 12:16:11.016317 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 448/930] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:10 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:11.021197 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-67189f22-ba7b-4d8e-89be-27432ce23640 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '.version_select at 0x7ff2d91e7310>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:11.041692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-67189f22-ba7b-4d8e-89be-27432ce23640 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728380854" status: 202 len: 0 microversion: 2.1 time: 0.024668 Sep 09 12:16:11.042226 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 483/931] 10.222.0.62 () {58 vars in 1221 bytes} [Fri Sep 9 12:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728380854 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:13.934590 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:13.935255 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:13.942938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:13.943668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:13.944111 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:13.944817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:13.945382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:13.945896 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:13.959943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] HTTP exception thrown: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Request method failure captured: Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 HTTP/1.1 Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxGRp8zUfZKxgEORoJVguGVTw7rk0QjbKx3lRBBLm-XfIry5RaOS-l9IZpMH4zZr9AVi52DmMZ8b1xrkqjwrSrPOA8KUJxWdUC8-ihKt09GW1SHzBXJTexSGZ5UJmtnJvwFSm-TTsNT8HUuneKcdueRR-FLXkDphH7AN_Jhzd3GeU4 Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:13.961515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0475d5537c6f4116ac0905e90153bbc7"}]}] Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: bfc29d15a7344754aa53d55379e2751f Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:13.963239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'c2652d36-5242-4ac9-8cee-b0447df90997'} Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:13.964185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:13.965481 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:13.966882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Returning 404 to user: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:13.966882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2a9a8b7f-83bd-47f6-839b-b13d3ff867f0 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 404 len: 111 microversion: 2.1 time: 0.032814 Sep 09 12:16:13.966882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 449/932] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:13 2022] DELETE /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:13.972709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:13.977058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:13.977671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: c2652d36-5242-4ac9-8cee-b0447df90997] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:13.984578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:13.985122 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:13.985608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:13.986895 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:13.987400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:13.987838 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:14.002804 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] HTTP exception thrown: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Request method failure captured: Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 HTTP/1.1 Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxGRp8zUfZKxgEORoJVguGVTw7rk0QjbKx3lRBBLm-XfIry5RaOS-l9IZpMH4zZr9AVi52DmMZ8b1xrkqjwrSrPOA8KUJxWdUC8-ihKt09GW1SHzBXJTexSGZ5UJmtnJvwFSm-TTsNT8HUuneKcdueRR-FLXkDphH7AN_Jhzd3GeU4 Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:16:14.004460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0475d5537c6f4116ac0905e90153bbc7"}]}] Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: bfc29d15a7344754aa53d55379e2751f Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:14.006072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': 'c2652d36-5242-4ac9-8cee-b0447df90997'} Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:14.007229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. Sep 09 12:16:14.008707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:14.010184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Returning 404 to user: Instance c2652d36-5242-4ac9-8cee-b0447df90997 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:14.010184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ce4e6adc-3b44-4b4b-94f9-c529637dd709 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997" status: 404 len: 111 microversion: 2.1 time: 0.034467 Sep 09 12:16:14.010184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 484/933] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:13 2022] GET /compute/v2.1/servers/c2652d36-5242-4ac9-8cee-b0447df90997 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:14.253239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:14.253860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:14.260120 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:14.260604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:14.261052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:14.261744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:14.262240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:14.262666 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:14.442654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:14.451712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-455cb069-fccd-4061-bb78-cf1dc3a6ed0b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1594 microversion: 2.1 time: 0.202384 Sep 09 12:16:14.452271 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 450/934] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:14 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1594 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:15.154246 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:15.154786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:15.161371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:15.161856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:15.162320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:15.163015 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:15.163460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:15.163879 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:15.177528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] HTTP exception thrown: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Request method failure captured: Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 HTTP/1.1 Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxGRp8zUfZKxgEORoJVguGVTw7rk0QjbKx3lRBBLm-XfIry5RaOS-l9IZpMH4zZr9AVi52DmMZ8b1xrkqjwrSrPOA8KUJxWdUC8-ihKt09GW1SHzBXJTexSGZ5UJmtnJvwFSm-TTsNT8HUuneKcdueRR-FLXkDphH7AN_Jhzd3GeU4 Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:16:15.179163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0475d5537c6f4116ac0905e90153bbc7"}]}] Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: bfc29d15a7344754aa53d55379e2751f Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.180706 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '00de6121-bfa1-4888-af77-69a8f8800324'} Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:15.181538 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.182881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.184121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Returning 404 to user: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:15.184121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-709d11d7-49ac-4a7b-8870-b894002f00cf tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "DELETE /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 404 len: 111 microversion: 2.1 time: 0.030260 Sep 09 12:16:15.184121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 485/935] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:15 2022] DELETE /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:15.189798 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:15.190430 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] [instance: 00de6121-bfa1-4888-af77-69a8f8800324] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:15.197250 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:15.197736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:15.198199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:15.198898 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:15.199353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:15.199775 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:15.214850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] HTTP exception thrown: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Request method failure captured: Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 HTTP/1.1 Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxGRp8zUfZKxgEORoJVguGVTw7rk0QjbKx3lRBBLm-XfIry5RaOS-l9IZpMH4zZr9AVi52DmMZ8b1xrkqjwrSrPOA8KUJxWdUC8-ihKt09GW1SHzBXJTexSGZ5UJmtnJvwFSm-TTsNT8HUuneKcdueRR-FLXkDphH7AN_Jhzd3GeU4 Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:15.216392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0475d5537c6f4116ac0905e90153bbc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0475d5537c6f4116ac0905e90153bbc7"}]}] Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 0475d5537c6f4116ac0905e90153bbc7 Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1779259609 Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: bfc29d15a7344754aa53d55379e2751f Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeTestJSON-1779259609-project Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.218015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '00de6121-bfa1-4888-af77-69a8f8800324'} Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:15.218996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. Sep 09 12:16:15.220631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:15.221972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] Returning 404 to user: Instance 00de6121-bfa1-4888-af77-69a8f8800324 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:15.221972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-43298f61-cf5b-4938-9a4c-9021778e1b71 tempest-AttachVolumeTestJSON-1779259609 tempest-AttachVolumeTestJSON-1779259609-project] 10.222.0.62 "GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324" status: 404 len: 111 microversion: 2.1 time: 0.032347 Sep 09 12:16:15.221972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 451/936] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:15 2022] GET /compute/v2.1/servers/00de6121-bfa1-4888-af77-69a8f8800324 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:15.533987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:15.534539 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:15.540997 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:15.541508 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:15.542154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:15.542894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:15.543313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:15.543995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:15.574857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0e83efe-396b-4152-a845-865807c2e2c1 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/ips" status: 200 len: 149 microversion: 2.1 time: 0.046464 Sep 09 12:16:15.575812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 486/937] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:16:15 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:16.202083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a374d321-ba2d-49d2-9cd3-8b2962e17a54 req-705a05ad-3887-4259-8fb1-5ac4718f3420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0badf4d4-3bf8-42ce-889d-90e70dc1b058", "tag": "78ddba5c-300e-4659-8539-78d51f625eb6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:16.213201 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a374d321-ba2d-49d2-9cd3-8b2962e17a54 req-705a05ad-3887-4259-8fb1-5ac4718f3420 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:16.213968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a374d321-ba2d-49d2-9cd3-8b2962e17a54 req-705a05ad-3887-4259-8fb1-5ac4718f3420 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:16.214656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a374d321-ba2d-49d2-9cd3-8b2962e17a54 req-705a05ad-3887-4259-8fb1-5ac4718f3420 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:16.229460 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a374d321-ba2d-49d2-9cd3-8b2962e17a54 req-705a05ad-3887-4259-8fb1-5ac4718f3420 service nova] Creating event network-changed:78ddba5c-300e-4659-8539-78d51f625eb6 for instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 on hv-cinder-85221 Sep 09 12:16:16.235163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a374d321-ba2d-49d2-9cd3-8b2962e17a54 req-705a05ad-3887-4259-8fb1-5ac4718f3420 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036635 Sep 09 12:16:16.235993 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 452/938] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:16.991097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "292a00b1-3c1a-46c0-b205-59661838dd1e"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:16.993700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:17.000537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:17.001265 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:17.002696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:17.002947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:17.003575 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:17.004002 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:17.342911 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f55eb8bd-6512-433f-ac3c-13d5f2618e06 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "POST /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356388 Sep 09 12:16:17.350258 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 487/939] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:16:16 2022] POST /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:17.778362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-20487833"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:17.779000 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:17.786165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:17.786662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:17.787104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:17.787825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:17.788291 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:17.788715 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:17.976921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.network.security_group_api [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Adding security group b049384e-592a-4d88-a8d0-26e434c9e3b3 to port 78ddba5c-300e-4659-8539-78d51f625eb6 Sep 09 12:16:18.767148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-92dde2db-28d6-46c5-b7c7-14abe8595f82 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/action" status: 202 len: 0 microversion: 2.1 time: 0.992977 Sep 09 12:16:18.768525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 453/940] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:16:17 2022] POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/action => generated 0 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:18.777790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:18.778531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:18.781535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:18.782083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-90e21371-e381-4d50-a56a-d19ea41fd012 req-60b02ad3-478d-4dd8-9d65-4aa99be78c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0badf4d4-3bf8-42ce-889d-90e70dc1b058", "tag": "78ddba5c-300e-4659-8539-78d51f625eb6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:18.785770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:18.786499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:18.786939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:18.787636 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:18.788257 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:18.788681 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:18.793558 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90e21371-e381-4d50-a56a-d19ea41fd012 req-60b02ad3-478d-4dd8-9d65-4aa99be78c21 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:18.794131 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90e21371-e381-4d50-a56a-d19ea41fd012 req-60b02ad3-478d-4dd8-9d65-4aa99be78c21 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:18.794464 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:18.794923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-90e21371-e381-4d50-a56a-d19ea41fd012 req-60b02ad3-478d-4dd8-9d65-4aa99be78c21 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:18.807737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-90e21371-e381-4d50-a56a-d19ea41fd012 req-60b02ad3-478d-4dd8-9d65-4aa99be78c21 service nova] Creating event network-changed:78ddba5c-300e-4659-8539-78d51f625eb6 for instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 on hv-cinder-85221 Sep 09 12:16:18.817112 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-90e21371-e381-4d50-a56a-d19ea41fd012 req-60b02ad3-478d-4dd8-9d65-4aa99be78c21 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038472 Sep 09 12:16:18.818469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 454/941] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:19.045867 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:19.059505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b1f86a42-2806-43c9-82d3-832571a24597 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1758 microversion: 2.1 time: 0.286010 Sep 09 12:16:19.061260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 488/942] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:18 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1758 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:21.339152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bc360f97-c751-4922-b2ff-8b940281787e tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Action: 'create', calling method: .version_select at 0x7ff2d90e1e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1407279931", "metadata": {"Type": "work"}}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:21.628168 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bc360f97-c751-4922-b2ff-8b940281787e tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.401061 Sep 09 12:16:21.628857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 455/943] 10.222.0.62 () {60 vars in 1156 bytes} [Fri Sep 9 12:16:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 403 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 09 12:16:21.643466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-03a2b1ed-d229-4684-af5c-c28daea6d973 tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Calling method '.version_select at 0x7ff2d91a45e0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:21.692789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-03a2b1ed-d229-4684-af5c-c28daea6d973 tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc" status: 200 len: 353 microversion: 2.1 time: 0.054050 Sep 09 12:16:21.693351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 489/944] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:16:21 2022] GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:22.708022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-249ebd20-e7b0-41a6-8cb7-028c449751cd tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Calling method '.version_select at 0x7ff2d9076ca0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:22.754659 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-249ebd20-e7b0-41a6-8cb7-028c449751cd tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc" status: 200 len: 354 microversion: 2.1 time: 0.051415 Sep 09 12:16:22.755254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 456/945] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:16:22 2022] GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:22.768909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c20cb787-e600-41c6-8e6b-b440125b68cf tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Calling method '.version_select at 0x7ff2d927bc10>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:22.815529 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c20cb787-e600-41c6-8e6b-b440125b68cf tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc" status: 200 len: 354 microversion: 2.1 time: 0.051273 Sep 09 12:16:22.816100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 490/946] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:16:22 2022] GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:22.834379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bdc5812-75c0-40d6-bd7f-14cde45c8b77 tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Calling method '.version_select at 0x7ff2d90763a0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:22.897739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bdc5812-75c0-40d6-bd7f-14cde45c8b77 tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc" status: 202 len: 0 microversion: 2.1 time: 0.067876 Sep 09 12:16:22.898348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 457/947] 10.222.0.62 () {58 vars in 1248 bytes} [Fri Sep 9 12:16:22 2022] DELETE /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:22.906404 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8a78bfd6-40c4-4999-a966-5d8e5b4d6bec tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Calling method '.version_select at 0x7ff2d927bd30>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:22.959927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8a78bfd6-40c4-4999-a966-5d8e5b4d6bec tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc" status: 200 len: 353 microversion: 2.1 time: 0.057225 Sep 09 12:16:22.960447 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 491/948] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:16:22 2022] GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:23.975573 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ed34895-6053-4059-bcdb-7480dea580bf tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Calling method '.version_select at 0x7ff2d90e14c0>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:24.003975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-4ed34895-6053-4059-bcdb-7480dea580bf tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] HTTP exception thrown: Volume fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc could not be found. Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ed34895-6053-4059-bcdb-7480dea580bf tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Request method failure captured: Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc HTTP/1.1 Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGy6VpN9CpxPG80zQ9zEdf6CFhBTbxMmC-c_PQjDAfOyJSb0_H0cuQFoRKgYG8NJNdnYhRW6z7wcXldXNsUTx_-IUdZ0iSRFowl4eSLqLMVnxvfVoYKh0aZM-XdoKKqxQeTCflHgrYtIgiBIs9fYf2IQInYlyMkZui-TUTPKney8ghes Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: b54810059a014d3d99879824cfcbb5f6 Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesGetTestJSON-820512937 Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:24.006057 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b54810059a014d3d99879824cfcbb5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b54810059a014d3d99879824cfcbb5f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b54810059a014d3d99879824cfcbb5f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b54810059a014d3d99879824cfcbb5f6"}]}] Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesGetTestJSON-820512937 Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: b54810059a014d3d99879824cfcbb5f6 Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesGetTestJSON-820512937 Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesGetTestJSON-820512937-project Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: d5fcb31d881b45fe9c790513767bb895 Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesGetTestJSON-820512937-project Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Volume fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc could not be found. Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc'} Sep 09 12:16:24.007722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc could not be found. (HTTP 404) (Request-ID: req-24a7e4ae-303a-4232-9666-5fdf9083948c) Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:24.008922 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 09 12:16:24.010455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc could not be found. Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 09 12:16:24.011998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc could not be found. Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc could not be found. Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4ed34895-6053-4059-bcdb-7480dea580bf tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] Returning 404 to user: Volume fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4ed34895-6053-4059-bcdb-7480dea580bf tempest-VolumesGetTestJSON-820512937 tempest-VolumesGetTestJSON-820512937-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc" status: 404 len: 109 microversion: 2.1 time: 0.036766 Sep 09 12:16:24.013527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 458/949] 10.222.0.62 () {58 vars in 1245 bytes} [Fri Sep 9 12:16:23 2022] GET /compute/v2.1/os-volumes/fb0a5b5b-af8f-48e9-9217-0c539f3b3bcc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:25.110951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:25.111767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:25.117755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.118527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.118961 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.119651 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.120107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.120523 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.213896 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lazy-loading 'services' on Instance uuid 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:25.287051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3d89bad0-10f8-4a9e-acf3-6ad510244cdc tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments/292a00b1-3c1a-46c0-b205-59661838dd1e" status: 202 len: 0 microversion: 2.1 time: 0.180336 Sep 09 12:16:25.287644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 492/950] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:16:25 2022] DELETE /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments/292a00b1-3c1a-46c0-b205-59661838dd1e => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:25.299740 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:25.303419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:25.306787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:25.313408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.314259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.315207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.315920 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:25.316380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:25.316808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:25.352446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4325fa0e-4de2-4280-9acd-766a35a2ca01 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059457 Sep 09 12:16:25.354438 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 459/951] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:16:25 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:26.366556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:26.369315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:26.375691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.376118 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.376555 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.377292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.377791 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.378243 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.408963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5b42095a-db34-4cba-8c28-93761eaf8967 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047791 Sep 09 12:16:26.409539 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 493/952] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:16:26 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:16:26.473951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:26.474515 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:26.480938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.481416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.481844 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.482562 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.483014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.483439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.510582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:16:26.745662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-304fd312-0d43-427e-aaf0-255baf3f96de tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 204 len: 0 microversion: 2.1 time: 0.275741 Sep 09 12:16:26.746836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 460/953] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:26 2022] DELETE /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:16:26.755311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:26.755922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:26.762274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.762797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.763231 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.763941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:26.764387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:26.764806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:26.898697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:26.906649 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9473bc12-2684-446f-a85f-c67be0462a52 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1681 microversion: 2.1 time: 0.155309 Sep 09 12:16:26.907211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 494/954] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:26 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:27.930834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:27.931568 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:27.938038 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:27.938561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:27.938998 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:27.940228 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:27.940717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:27.941144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:28.073022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:28.080719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-72babee8-3488-4e19-a1a8-7f62fe87c43a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1681 microversion: 2.1 time: 0.154122 Sep 09 12:16:28.081269 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 461/955] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:27 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:29.103513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:29.104112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:29.110596 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:29.111106 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:29.111532 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:29.112218 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:29.112671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:29.113093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:29.354249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:29.361962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-07f509f2-4744-44eb-a5b3-650033f54c8e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1681 microversion: 2.1 time: 0.262297 Sep 09 12:16:29.362632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 495/956] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:29 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:29.839374 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-f49c88d3-d564-400d-bd80-737f1bc0170d req-2073001f-0ecb-4aa1-a7b6-e1b6a1253581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c98f12d-98d4-4f46-a1b5-a0b7735f6755", "name": "network-vif-deleted", "tag": "7e5ba6d3-ae76-45b3-8d33-397c36a7ae50"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:29.852572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f49c88d3-d564-400d-bd80-737f1bc0170d req-2073001f-0ecb-4aa1-a7b6-e1b6a1253581 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:29.853114 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f49c88d3-d564-400d-bd80-737f1bc0170d req-2073001f-0ecb-4aa1-a7b6-e1b6a1253581 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:29.853816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-f49c88d3-d564-400d-bd80-737f1bc0170d req-2073001f-0ecb-4aa1-a7b6-e1b6a1253581 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:29.866212 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-f49c88d3-d564-400d-bd80-737f1bc0170d req-2073001f-0ecb-4aa1-a7b6-e1b6a1253581 service nova] Creating event network-vif-deleted:7e5ba6d3-ae76-45b3-8d33-397c36a7ae50 for instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 on hv-cinder-85221 Sep 09 12:16:29.872059 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-f49c88d3-d564-400d-bd80-737f1bc0170d req-2073001f-0ecb-4aa1-a7b6-e1b6a1253581 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Sep 09 12:16:29.873158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 462/957] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:16:30.385572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:30.386224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:30.393672 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:30.394352 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:30.395745 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:30.396979 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:30.397471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:30.398246 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:30.449211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:30.449683 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:30.450695 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:30.451205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lazy-loading 'fault' on Instance uuid 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:16:30.513260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c99b5db9794dff83ea1b67fd238655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e38a10fcf8400394897df5f65428b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:30.521606 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1a0c4a14-1af3-4e8a-9ab4-3e951db7700c tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 200 len: 1331 microversion: 2.1 time: 0.139853 Sep 09 12:16:30.522444 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 496/958] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:30 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:16:31.545786 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:31.546509 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:31.553428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:31.553905 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:31.554538 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:31.555053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:31.555502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:31.556303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:31.570781 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 HTTP/1.1 Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:31.572468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:31.573962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '2c98f12d-98d4-4f46-a1b5-a0b7735f6755'} Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:31.574914 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:31.576560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:31.578054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:31.578054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ceae23a6-2301-4a34-961b-dd88e088d00e tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 404 len: 111 microversion: 2.1 time: 0.032801 Sep 09 12:16:31.578054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 463/959] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:31 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:31.584162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-71b8ba8b-d51e-4a5d-9e38-69f91f085588 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '.version_select at 0x7ff2d927c3a0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:31.605455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-71b8ba8b-d51e-4a5d-9e38-69f91f085588 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673706027" status: 202 len: 0 microversion: 2.1 time: 0.026072 Sep 09 12:16:31.606794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 497/960] 10.222.0.62 () {58 vars in 1218 bytes} [Fri Sep 9 12:16:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673706027 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:16:33.365302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:33.365811 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:33.372440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.372927 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.373387 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.374081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.374573 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.375000 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.388624 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 HTTP/1.1 Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:33.390180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.391725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '2c98f12d-98d4-4f46-a1b5-a0b7735f6755'} Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:33.392670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.394290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.395710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:33.395710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-927ef110-591c-4496-9a22-75b803d02b84 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 404 len: 111 microversion: 2.1 time: 0.030809 Sep 09 12:16:33.395710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 464/961] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:33 2022] DELETE /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:33.400197 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:33.400813 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 2c98f12d-98d4-4f46-a1b5-a0b7735f6755] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:33.408174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.408657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.409093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.409779 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:33.410270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:33.410697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:33.424202 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 HTTP/1.1 Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:16:33.425849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.427373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '2c98f12d-98d4-4f46-a1b5-a0b7735f6755'} Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:33.428250 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. Sep 09 12:16:33.429698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:33.430951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 2c98f12d-98d4-4f46-a1b5-a0b7735f6755 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:33.430951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9027da1a-7a5f-42f4-a5b1-84e54e7e050b tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755" status: 404 len: 111 microversion: 2.1 time: 0.030929 Sep 09 12:16:33.430951 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 498/962] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:33 2022] GET /compute/v2.1/servers/2c98f12d-98d4-4f46-a1b5-a0b7735f6755 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:16:34.566897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:34.567442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:34.573651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.574139 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.574582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.575272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.575720 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.576137 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.595736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 HTTP/1.1 Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:34.597293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.598911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '45fc4606-72de-4cf6-842b-58f6a51f0f12'} Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:34.599718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.600921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.602129 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:34.602129 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-806a21cc-b5f5-49b8-8f76-aff821643251 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 404 len: 111 microversion: 2.1 time: 0.036315 Sep 09 12:16:34.602129 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 465/963] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:34 2022] DELETE /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:34.607525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:34.608145 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 45fc4606-72de-4cf6-842b-58f6a51f0f12] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:34.614691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.615184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.615628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.616421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.616767 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.617212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.631141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 HTTP/1.1 Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:16:34.632663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.634212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '45fc4606-72de-4cf6-842b-58f6a51f0f12'} Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:34.635055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. Sep 09 12:16:34.636290 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.637398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 45fc4606-72de-4cf6-842b-58f6a51f0f12 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:34.637398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9f600b21-3ca3-4334-a87e-afbce97d3e4a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12" status: 404 len: 111 microversion: 2.1 time: 0.030423 Sep 09 12:16:34.637398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 499/964] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:34 2022] GET /compute/v2.1/servers/45fc4606-72de-4cf6-842b-58f6a51f0f12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:34.644008 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:34.644486 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:34.650507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.650985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.651415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.652096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.652717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.653093 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.666332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 HTTP/1.1 Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:34.667845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.669465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'd3a56358-0027-49dc-ba72-8b3d31456c08'} Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:34.670347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.671821 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.673287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:34.673287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2d5b667e-4e34-489c-917f-29125d2fb82a tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 404 len: 111 microversion: 2.1 time: 0.029791 Sep 09 12:16:34.673287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 466/965] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:34 2022] DELETE /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:34.677678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:34.678321 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: d3a56358-0027-49dc-ba72-8b3d31456c08] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:34.684210 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.684691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.685129 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.685822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:34.686311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:34.686740 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:34.700278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 HTTP/1.1 Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:16:34.701765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.703400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': 'd3a56358-0027-49dc-ba72-8b3d31456c08'} Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:34.704324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. Sep 09 12:16:34.706513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:34.708137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance d3a56358-0027-49dc-ba72-8b3d31456c08 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:34.708137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9ae89fee-7b35-4268-b7d9-346d259fbbad tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08" status: 404 len: 111 microversion: 2.1 time: 0.029334 Sep 09 12:16:34.708137 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 500/966] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:34 2022] GET /compute/v2.1/servers/d3a56358-0027-49dc-ba72-8b3d31456c08 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:35.852408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:35.853848 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:35.861071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.861777 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.862495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.863635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.864302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.864755 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.881349 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 HTTP/1.1 Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:35.883011 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.884354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '92db74a9-d7a5-4405-919d-b1ae5f3b8381'} Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:35.885899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.887471 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.890759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:35.890759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e82708ef-5a4e-4eaa-80ed-9e899c9456e7 tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "DELETE /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 404 len: 111 microversion: 2.1 time: 0.036827 Sep 09 12:16:35.890759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 467/967] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:16:35 2022] DELETE /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:35.893400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:35.894013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] [instance: 92db74a9-d7a5-4405-919d-b1ae5f3b8381] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:35.900659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.901159 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.901587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.902319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:35.902769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:35.903184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:35.920247 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] HTTP exception thrown: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Request method failure captured: Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 HTTP/1.1 Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxMNdxTfyoqjZkkoTodcJhM-_-NOgLOS0WcPVwigLt5jEanuQdsZRpDR8IPdhXtycaIYdUVQokCjajgidFHt4FntiuwLQ7QC0op5TsxqVgwY7NVKdIja_M6kKJZZHrnO26P1_AObSuuEak_NVmNMK4F7r2X7NuITyWzMKrD-3VHVIE Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:16:35.921460 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_51e38a10fcf8400394897df5f65428b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/51e38a10fcf8400394897df5f65428b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/51e38a10fcf8400394897df5f65428b0"}]}] Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 51e38a10fcf8400394897df5f65428b0 Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-322775924 Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 16c99b5db9794dff83ea1b67fd238655 Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeNegativeTest-322775924-project Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.923519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '92db74a9-d7a5-4405-919d-b1ae5f3b8381'} Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:35.924628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. Sep 09 12:16:35.925909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:16:35.927055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] Returning 404 to user: Instance 92db74a9-d7a5-4405-919d-b1ae5f3b8381 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:35.927055 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-229dc7e3-1d54-4b8d-b501-35033000901f tempest-AttachVolumeNegativeTest-322775924 tempest-AttachVolumeNegativeTest-322775924-project] 10.222.0.62 "GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381" status: 404 len: 111 microversion: 2.1 time: 0.033823 Sep 09 12:16:35.927958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 501/968] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:16:35 2022] GET /compute/v2.1/servers/92db74a9-d7a5-4405-919d-b1ae5f3b8381 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:16:53.815685 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:53.817845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:53.820085 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:53.820719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:53.826682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:53.827160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:53.827589 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:53.828274 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:53.828723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:53.829142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:53.860791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-291d420a-9dbd-4a29-90f1-3d2d7acedd50 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049325 Sep 09 12:16:53.861352 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 468/969] 10.222.0.62 () {60 vars in 1343 bytes} [Fri Sep 9 12:16:53 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:16:53.933675 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:53.934320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:53.936582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:53.937265 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:16:53.943637 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:53.944121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:53.944559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:53.945249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:53.945699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:53.946141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:53.973282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:16:54.048620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ffac0b42-3cc6-4ac9-89aa-0372aac4910a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 204 len: 0 microversion: 2.20 time: 0.118571 Sep 09 12:16:54.049204 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 502/970] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 9 12:16:53 2022] DELETE /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 12:16:54.058203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:54.058810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:54.065248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:54.065784 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:54.066241 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:54.066930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:54.067383 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:54.067807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:54.200599 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:54.209305 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:54.210760 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:54.211900 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a8cd91b0-0eb6-4369-a53f-1b33e64d689f tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.157699 Sep 09 12:16:54.212447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 469/971] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:54 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 09 12:16:55.237331 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:55.238030 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:55.244752 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:55.245230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:55.245658 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:55.246373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:55.246822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:55.247238 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:55.390970 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:55.401461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:55.403098 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:55.404459 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-cd72550d-08ae-49a8-83f5-7502017621b1 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.171437 Sep 09 12:16:55.405007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 503/972] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:55 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:56.435028 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:56.436555 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:56.444596 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:56.445199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:56.445864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:56.446822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:56.447337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:56.447851 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:56.634813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:56.649814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:56.659030 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9676597a1b884138bf5435f3b6cd63c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002ffc44d77748ae9c618229e21f41e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:16:56.661660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ec4b4c0c-53f4-479a-b99d-84a40c012289 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 200 len: 1722 microversion: 2.20 time: 0.234201 Sep 09 12:16:56.662635 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 470/973] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:56 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 09 12:16:56.950883 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-41466074-5605-4742-b7bd-1890d56c83e9 req-034f0cf8-3ff3-4a52-899f-9e957ede3338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a483ee57-2187-4440-8e0d-10a5fedec303", "name": "network-vif-deleted", "tag": "77b9c61a-9f4b-48fb-a52b-6900d4ee0b57"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:16:56.972411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-41466074-5605-4742-b7bd-1890d56c83e9 req-034f0cf8-3ff3-4a52-899f-9e957ede3338 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:56.973489 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-41466074-5605-4742-b7bd-1890d56c83e9 req-034f0cf8-3ff3-4a52-899f-9e957ede3338 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:56.973902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-41466074-5605-4742-b7bd-1890d56c83e9 req-034f0cf8-3ff3-4a52-899f-9e957ede3338 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:56.997306 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-41466074-5605-4742-b7bd-1890d56c83e9 req-034f0cf8-3ff3-4a52-899f-9e957ede3338 service nova] Creating event network-vif-deleted:77b9c61a-9f4b-48fb-a52b-6900d4ee0b57 for instance a483ee57-2187-4440-8e0d-10a5fedec303 on hv-cinder-85221 Sep 09 12:16:57.003689 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-41466074-5605-4742-b7bd-1890d56c83e9 req-034f0cf8-3ff3-4a52-899f-9e957ede3338 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061579 Sep 09 12:16:57.009380 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 504/974] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:16:57.691054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:57.691759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:57.699692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:57.700376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:57.700972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:57.701869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:57.702514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:57.703113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:57.717901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] HTTP exception thrown: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Request method failure captured: Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 HTTP/1.1 Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxF-zHJ8xYgKP4LcVxzdbpd5LxDxHPR3J-OTO_uZzlE5y7zqqe3LU-qEgzF_ZD-XFl__0bZ5h2tQjH9B640qUp9JpF_B0mzOqq4hIMs_8sMGOE8xnqghV1dMsTYkH7MRMNl8LluOeuHQzVILD4zndkWoO6kURWYviphYjWHWELSKnI Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:16:57.719824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/002ffc44d77748ae9c618229e21f41e8"}]}] Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 9676597a1b884138bf5435f3b6cd63c1 Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:16:57.721654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'a483ee57-2187-4440-8e0d-10a5fedec303'} Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:16:57.722623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:16:57.724113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:16:57.726583 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Returning 404 to user: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:16:57.728107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ccd1ab0b-615d-4bdb-a7e5-fbb436ea3e6a tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 404 len: 111 microversion: 2.20 time: 0.042528 Sep 09 12:16:57.728933 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 471/975] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:16:57 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:16:57.740780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fbcdce41-d02e-4ac1-94bf-f1f9669ac90c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '.version_select at 0x7ff2d90df280>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:57.765737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fbcdce41-d02e-4ac1-94bf-f1f9669ac90c tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-368523301" status: 204 len: 0 microversion: 2.20 time: 0.030676 Sep 09 12:16:57.766741 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 505/976] 10.222.0.62 () {60 vars in 1259 bytes} [Fri Sep 9 12:16:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-368523301 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 09 12:16:59.959569 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:16:59.960487 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:16:59.968003 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.968526 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.969695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:59.970868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:16:59.971503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:16:59.972029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:16:59.998754 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] HTTP exception thrown: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Request method failure captured: Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 HTTP/1.1 Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxF-zHJ8xYgKP4LcVxzdbpd5LxDxHPR3J-OTO_uZzlE5y7zqqe3LU-qEgzF_ZD-XFl__0bZ5h2tQjH9B640qUp9JpF_B0mzOqq4hIMs_8sMGOE8xnqghV1dMsTYkH7MRMNl8LluOeuHQzVILD4zndkWoO6kURWYviphYjWHWELSKnI Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:17:00.000642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/002ffc44d77748ae9c618229e21f41e8"}]}] Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 9676597a1b884138bf5435f3b6cd63c1 Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.002796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'a483ee57-2187-4440-8e0d-10a5fedec303'} Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:17:00.003964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.005446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.007872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Returning 404 to user: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:17:00.007872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-016707da-f9ac-4465-b9b6-9155d19397c7 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 404 len: 111 microversion: 2.20 time: 0.049614 Sep 09 12:17:00.007872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 472/977] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 9 12:16:59 2022] DELETE /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:17:00.012352 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:00.013599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: a483ee57-2187-4440-8e0d-10a5fedec303] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:00.022353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:00.022353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:00.022730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:00.023642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:00.024103 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:00.024534 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:00.039164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] HTTP exception thrown: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Request method failure captured: Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 HTTP/1.1 Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxF-zHJ8xYgKP4LcVxzdbpd5LxDxHPR3J-OTO_uZzlE5y7zqqe3LU-qEgzF_ZD-XFl__0bZ5h2tQjH9B640qUp9JpF_B0mzOqq4hIMs_8sMGOE8xnqghV1dMsTYkH7MRMNl8LluOeuHQzVILD4zndkWoO6kURWYviphYjWHWELSKnI Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:17:00.040890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/002ffc44d77748ae9c618229e21f41e8"}]}] Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9676597a1b884138bf5435f3b6cd63c1 Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.042475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': 'a483ee57-2187-4440-8e0d-10a5fedec303'} Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:17:00.043283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. Sep 09 12:17:00.045046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:00.046869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Returning 404 to user: Instance a483ee57-2187-4440-8e0d-10a5fedec303 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:17:00.046869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11cf1353-8a6b-4068-b0af-910002ffa046 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303" status: 404 len: 111 microversion: 2.20 time: 0.035013 Sep 09 12:17:00.046869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 506/978] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:00 2022] GET /compute/v2.1/servers/a483ee57-2187-4440-8e0d-10a5fedec303 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:17:01.229358 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:01.229980 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:01.237455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.237932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.238405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.239134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.239864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.240211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.255325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] HTTP exception thrown: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Request method failure captured: Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 HTTP/1.1 Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGyxF-zHJ8xYgKP4LcVxzdbpd5LxDxHPR3J-OTO_uZzlE5y7zqqe3LU-qEgzF_ZD-XFl__0bZ5h2tQjH9B640qUp9JpF_B0mzOqq4hIMs_8sMGOE8xnqghV1dMsTYkH7MRMNl8LluOeuHQzVILD4zndkWoO6kURWYviphYjWHWELSKnI Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:17:01.256934 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/002ffc44d77748ae9c618229e21f41e8"}]}] Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 9676597a1b884138bf5435f3b6cd63c1 Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.258695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '214a4341-91a9-4b8e-b1db-4e07620cfbf7'} Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:17:01.259735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.261594 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.263200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Returning 404 to user: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:17:01.263200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-027cc9a9-e212-4078-8fb4-4b14bec1fbdc tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "DELETE /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 404 len: 111 microversion: 2.20 time: 0.034121 Sep 09 12:17:01.263200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 473/979] 10.222.0.62 () {60 vars in 1280 bytes} [Fri Sep 9 12:17:01 2022] DELETE /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:17:01.269305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:01.269923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] [instance: 214a4341-91a9-4b8e-b1db-4e07620cfbf7] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:01.277181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.277670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.278104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.283343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:01.283343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:01.283343 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:01.304537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] HTTP exception thrown: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Request method failure captured: Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 HTTP/1.1 Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGyxF-zHJ8xYgKP4LcVxzdbpd5LxDxHPR3J-OTO_uZzlE5y7zqqe3LU-qEgzF_ZD-XFl__0bZ5h2tQjH9B640qUp9JpF_B0mzOqq4hIMs_8sMGOE8xnqghV1dMsTYkH7MRMNl8LluOeuHQzVILD4zndkWoO6kURWYviphYjWHWELSKnI Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Openstack-Nova-Api-Version: 2.20 Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:17:01.306170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/002ffc44d77748ae9c618229e21f41e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/002ffc44d77748ae9c618229e21f41e8"}]}] Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 002ffc44d77748ae9c618229e21f41e8 Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1919291018 Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: 9676597a1b884138bf5435f3b6cd63c1 Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1919291018-project Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.307609 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '214a4341-91a9-4b8e-b1db-4e07620cfbf7'} Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:17:01.308415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. Sep 09 12:17:01.309661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:17:01.313972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] Returning 404 to user: Instance 214a4341-91a9-4b8e-b1db-4e07620cfbf7 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:17:01.313972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6e9d5207-2ec0-4faa-a487-06c5ad56d283 tempest-AttachVolumeShelveTestJSON-1919291018 tempest-AttachVolumeShelveTestJSON-1919291018-project] 10.222.0.62 "GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7" status: 404 len: 111 microversion: 2.20 time: 0.042816 Sep 09 12:17:01.313972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 507/980] 10.222.0.62 () {60 vars in 1277 bytes} [Fri Sep 9 12:17:01 2022] GET /compute/v2.1/servers/214a4341-91a9-4b8e-b1db-4e07620cfbf7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 09 12:17:02.452545 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-630670313", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "networks": [{"uuid": "8714ac38-13f0-4ec7-82b2-7e59c29180b4"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:02.516349 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] validate_networks() for [('8714ac38-13f0-4ec7-82b2-7e59c29180b4', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:17:03.074878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:17:03.075684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:17:03.076334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:17:03.076916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:17:03.078051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:17:03.090930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:03.091596 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:03.092552 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:03.093777 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:03.094561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:03.095173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:03.116145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Getting quotas for project 770c076806c64cd78d35f095ee489bcf. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:17:03.121874 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Getting quotas for user f849563115ec4a4e859a7395a03a561a and project 770c076806c64cd78d35f095ee489bcf. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:17:03.138033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:17:03.140952 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:17:03.224505 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e76bc47e-9b93-492c-9229-d4792a0f0708 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774776 Sep 09 12:17:03.227766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 474/981] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:17:03.241215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7ccae241-7837-4f0e-b29f-e9cbb8d48d0f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:03.242066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7ccae241-7837-4f0e-b29f-e9cbb8d48d0f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:03.644568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7ccae241-7837-4f0e-b29f-e9cbb8d48d0f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:03.656398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7ccae241-7837-4f0e-b29f-e9cbb8d48d0f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1218 microversion: 2.1 time: 0.421358 Sep 09 12:17:03.671524 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 508/982] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:03 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1218 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:04.692221 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:04.693647 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:04.702813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:04.703666 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:04.704442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:04.705975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:04.706696 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:04.707411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:04.872984 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:04.884539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6bcfe9ba-eac5-4711-bee0-d04e2193b79b tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1278 microversion: 2.1 time: 0.204410 Sep 09 12:17:04.889628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 475/983] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:04 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:05.919198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:05.920066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:05.928316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:05.928900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:05.929410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:05.930201 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:05.930870 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:05.931298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:06.100555 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:06.108745 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5da136b8-2894-4263-b811-fe20abf405d6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.200101 Sep 09 12:17:06.109323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 509/984] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:05 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:06.966676 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d0a267c1-55bb-4844-a951-78847588e212 req-8886b683-d580-4285-b943-e308352d56e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c011eb80-e0e3-4edb-b79d-bec7d92dfbf4", "tag": "45530925-4487-4700-9412-2c1abc97107c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:06.978303 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0a267c1-55bb-4844-a951-78847588e212 req-8886b683-d580-4285-b943-e308352d56e9 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:06.978863 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0a267c1-55bb-4844-a951-78847588e212 req-8886b683-d580-4285-b943-e308352d56e9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:06.979361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d0a267c1-55bb-4844-a951-78847588e212 req-8886b683-d580-4285-b943-e308352d56e9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:06.992560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d0a267c1-55bb-4844-a951-78847588e212 req-8886b683-d580-4285-b943-e308352d56e9 service nova] Creating event network-changed:45530925-4487-4700-9412-2c1abc97107c for instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 on hv-cinder-85221 Sep 09 12:17:06.998054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d0a267c1-55bb-4844-a951-78847588e212 req-8886b683-d580-4285-b943-e308352d56e9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034979 Sep 09 12:17:06.998604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 476/985] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:07.134036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:07.135296 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:07.148854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.149478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.150041 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.151168 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:07.151835 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:07.152357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:07.384592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:07.395975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-11696eb1-d0b8-43cf-a5c2-3e116127c269 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.266765 Sep 09 12:17:07.396562 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 510/986] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:07 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:17:08.419614 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:08.420322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:08.427054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:08.427544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:08.427990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:08.428736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:08.429157 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:08.429588 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:08.568522 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:08.576161 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-36996ba9-f23f-4b34-a08a-d43bca067602 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.160761 Sep 09 12:17:08.576718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 477/987] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:08 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:09.601167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:09.601743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:09.608062 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:09.608537 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:09.608963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:09.609629 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:09.610075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:09.610518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:09.749019 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:09.756745 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-88a81404-93a9-433b-b22e-e88de5c24853 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.159540 Sep 09 12:17:09.757302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 511/988] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:09 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:10.779276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:10.779889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:10.786817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:10.787318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:10.787711 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:10.788450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:10.788863 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:10.789289 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:10.944582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:10.952739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-baeca167-5522-40fd-8c85-f05e197e55b4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.177238 Sep 09 12:17:10.953299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 478/989] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:10 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:11.976409 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:11.977027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:11.983450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:11.983929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:11.984360 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:11.985049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:11.986162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:11.986516 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:12.132980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:12.140988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-819684eb-5766-4baf-bc62-2c6996447a89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.168237 Sep 09 12:17:12.142032 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 512/990] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:11 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:12.582135 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d5f4c7db-0c3a-46e3-a184-601fb6845e57 req-b1ce5a0d-bfb2-4b9a-aa00-e206745c2e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c011eb80-e0e3-4edb-b79d-bec7d92dfbf4", "name": "network-vif-plugged", "status": "completed", "tag": "45530925-4487-4700-9412-2c1abc97107c"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:12.592793 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d5f4c7db-0c3a-46e3-a184-601fb6845e57 req-b1ce5a0d-bfb2-4b9a-aa00-e206745c2e44 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:12.593138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d5f4c7db-0c3a-46e3-a184-601fb6845e57 req-b1ce5a0d-bfb2-4b9a-aa00-e206745c2e44 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:12.593607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d5f4c7db-0c3a-46e3-a184-601fb6845e57 req-b1ce5a0d-bfb2-4b9a-aa00-e206745c2e44 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:12.606761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d5f4c7db-0c3a-46e3-a184-601fb6845e57 req-b1ce5a0d-bfb2-4b9a-aa00-e206745c2e44 service nova] Creating event network-vif-plugged:45530925-4487-4700-9412-2c1abc97107c for instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 on hv-cinder-85221 Sep 09 12:17:12.611600 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d5f4c7db-0c3a-46e3-a184-601fb6845e57 req-b1ce5a0d-bfb2-4b9a-aa00-e206745c2e44 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033930 Sep 09 12:17:12.612499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 479/991] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:17:13.164727 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:13.165344 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:13.171897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:13.172383 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:13.172824 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:13.174080 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:13.174578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:13.175006 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:13.316672 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:13.324712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c32b6a75-8dbb-41bf-9cee-da8db2342adf tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.163700 Sep 09 12:17:13.325282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 513/992] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:13 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:14.349267 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:14.350498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:14.352662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:14.353325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:14.360266 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:14.360814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:14.361256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:14.361956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:14.362444 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:14.362879 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:14.771864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:14.782048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-37cd1c93-737c-479a-a998-13268f6d3ff7 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1318 microversion: 2.1 time: 0.437911 Sep 09 12:17:14.783705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 480/993] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:14 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:15.806507 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:15.807128 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:15.809075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:15.816292 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:15.816770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:15.817195 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:15.818141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:15.818534 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:15.818980 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:15.956902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:15.965501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0d08cfd1-b746-4318-9366-25d3d59e99c1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1508 microversion: 2.1 time: 0.162945 Sep 09 12:17:15.966211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 514/994] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:15 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:30.470355 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:17:30.472740 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:30.474902 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:30.475661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=54 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:30.482667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:30.483392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:30.484017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:30.485127 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:30.485256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:30.489588 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:30.607053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3db892e9-1f64-4672-a508-b3b786c9faba tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/action" status: 202 len: 0 microversion: 2.1 time: 0.140360 Sep 09 12:17:30.608144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 481/995] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:17:30 2022] POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:17:30.617952 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:30.619470 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:30.623857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:30.625175 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:17:30.632017 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:30.632742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:30.633888 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:30.634580 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:30.635335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:30.635815 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:30.868714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:30.877820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c9db27a4-c837-4b0d-9b3c-80e6ce85c471 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1750 microversion: 2.1 time: 0.263859 Sep 09 12:17:30.878719 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 515/996] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:30 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1750 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:31.901979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:31.902722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:31.909155 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:31.909673 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:31.910145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:31.910853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:31.911314 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:31.911742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:32.060058 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:32.069051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8390ecf2-6aa7-4ac1-b8ad-6a4cbe66a1d4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.171870 Sep 09 12:17:32.069617 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 482/997] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:31 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:33.093475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:33.094107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:33.101100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:33.101587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:33.102024 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:33.102750 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:33.103207 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:33.103632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:33.250814 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:33.259985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-17897998-0238-4a7f-be78-19ea91a9d0ee tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.171451 Sep 09 12:17:33.260562 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 516/998] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:33 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:34.282593 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:34.283295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:34.290390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:34.290874 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:34.291308 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:34.291994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:34.292448 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:34.292874 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:34.434734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:34.442991 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0af486db-c8c6-4735-8cd9-a7c6514f1a00 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.164274 Sep 09 12:17:34.443549 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 483/999] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:34 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:35.466353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:35.466975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:35.473995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:35.474562 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:35.475010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:35.475710 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:35.476165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:35.476590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:35.617761 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:35.626309 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0e346e3-cfb3-43ec-9145-dbf654b784b8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.163745 Sep 09 12:17:35.626937 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 517/1000] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:35 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:36.650313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:36.650916 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:36.657379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:36.657865 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:36.658337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:36.659658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:36.660119 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:36.660550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:36.804246 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:36.813009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd47abcd-b0b6-4b44-adba-a8791d0ea84f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.166636 Sep 09 12:17:36.813570 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 484/1001] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:36 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:37.836145 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:37.836789 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:37.843865 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:37.844344 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:37.844778 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:37.845466 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:37.845919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:37.846856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:37.993620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:38.002046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-09174273-e786-43bd-a0a5-cf7babd3a2ed tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.169781 Sep 09 12:17:38.002837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 518/1002] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:37 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:39.025052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:39.025666 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:39.032107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:39.032586 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:39.033014 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:39.033699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:39.034180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:39.034609 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:39.182209 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:39.190900 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0bae034f-376e-44cf-85bf-213e99c4ee55 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.169718 Sep 09 12:17:39.191468 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 485/1003] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:39 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:40.214651 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:40.215393 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:40.222377 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:40.222862 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:40.223293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:40.223978 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:40.224432 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:40.224859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:40.366561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:40.375035 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b3aa4a44-21b4-4648-8c93-128cb2fbf3d8 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.164258 Sep 09 12:17:40.375615 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 519/1004] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:40 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:41.398328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:41.398869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:41.405398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:41.405919 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:41.406346 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:41.407036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:41.407492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:41.407915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:41.548222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:41.557220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e706f200-45bf-41f3-a00c-933a325e5b1d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.162856 Sep 09 12:17:41.557785 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 486/1005] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:41 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:42.581026 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:42.581792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:42.588256 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:42.588724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:42.589171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:42.589894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:42.590458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:42.590827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:42.737712 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:42.746283 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3a6c346a-93dc-45f0-9c78-6c0f934b1a3c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.169729 Sep 09 12:17:42.746851 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 520/1006] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:42 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:43.770362 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:43.771133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:43.778443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:43.778930 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:43.779364 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:43.780070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:43.780529 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:43.780982 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:43.926996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:43.934972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1b2f4487-e808-4ebe-af35-8a00745d633d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.169705 Sep 09 12:17:43.935528 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 487/1007] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:43 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:44.958333 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:44.958946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:44.965422 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:44.965905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:44.966379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:44.967069 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:44.967521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:44.967944 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:45.105988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:45.114975 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21d2bb5a-260d-4014-aa00-0aa65c19073c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.160534 Sep 09 12:17:45.115547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 521/1008] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:44 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:46.138871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:46.139483 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:46.146631 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:46.147118 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:46.147557 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:46.148252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:46.148708 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:46.149136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:46.290539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:46.303826 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-10003e4a-7663-4bea-a269-7538eb2ec611 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.167923 Sep 09 12:17:46.304464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 488/1009] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:46 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:47.330136 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:47.330990 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:47.338099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:47.338624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:47.339065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:47.339766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:47.340229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:47.340657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:47.482849 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:47.491170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0cdda4f-8745-4e05-a99d-6c971f8c4308 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.164907 Sep 09 12:17:47.491747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 522/1010] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:47 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:48.514182 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:48.514797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:48.521260 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:48.521739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:48.522498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:48.523269 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:48.523632 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:48.524095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:48.669137 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:48.677837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ce4be2ab-72e0-42ab-9e48-08e34b1929cc tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.167653 Sep 09 12:17:48.678434 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 489/1011] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:48 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:49.700690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:49.701297 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:49.707777 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:49.708264 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:49.708724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:49.709408 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:49.709855 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:49.710299 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:49.866696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:49.876014 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c93d97c-884d-43d7-aca4-43cfe52481c4 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.179033 Sep 09 12:17:49.876625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 523/1012] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:49 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:50.900102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:50.900719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:50.907851 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:50.908497 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:50.908943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:50.909637 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:50.910097 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:50.910549 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:51.062652 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:51.072196 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fc50cbce-7f09-4b3b-ae9d-df361c72de2b tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.176076 Sep 09 12:17:51.081686 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 490/1013] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:50 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:52.095276 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:52.095895 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:52.102777 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:52.103287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:52.103725 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:52.104441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:52.104920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:52.105368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:52.248819 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:52.257528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-026844a9-46bd-4438-b535-35c070f01db2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.166106 Sep 09 12:17:52.258109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 524/1014] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:52 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:53.280938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:53.281565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:53.288735 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:53.289225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:53.289665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:53.290409 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:53.290870 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:53.291300 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:53.438225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:53.446996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5c26cc4-e518-4cf1-95f3-4b8bac345895 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.170041 Sep 09 12:17:53.447565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 491/1015] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:53 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:54.470734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:54.471353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:54.478048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:54.478509 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:54.478948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:54.479670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:54.480128 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:54.480554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:54.634063 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:54.642468 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a5d142ba-5d2a-40ce-8a3d-776050dd95f2 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.175697 Sep 09 12:17:54.643058 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 525/1016] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:54 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:55.666654 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:55.667296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:55.674009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:55.674526 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:55.674967 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:55.676340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:55.676824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:55.677281 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:55.822099 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:55.830478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4a48d9d9-a12c-4cf1-9c25-4998ad058439 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.167888 Sep 09 12:17:55.831049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 492/1017] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:55 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:56.853982 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:56.854650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:56.861323 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:56.861807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:56.862273 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:56.862962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:56.863906 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:56.864326 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:57.011502 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:57.019908 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-eba0e1e8-e1e3-4ade-bb5e-112e45855499 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.169774 Sep 09 12:17:57.020476 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 526/1018] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:56 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:58.048498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:58.049170 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:58.056225 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:58.056737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:58.057140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:58.057828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:58.058311 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:58.058730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:58.199211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:58.208047 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-02a75d29-9376-4cc3-b006-30baafeac602 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.168947 Sep 09 12:17:58.208608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 493/1019] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:58 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:17:59.231030 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:17:59.231635 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:17:59.239217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:59.239696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:59.240122 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:59.240926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:17:59.241456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:17:59.241878 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:17:59.387962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:17:59.396866 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0bd757a7-c74e-430e-884a-a0080b20b2a3 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.169650 Sep 09 12:17:59.397446 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 527/1020] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:17:59 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:00.421560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:00.422143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:00.429448 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:00.429936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:00.430405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:00.431113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:00.431572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:00.431999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:00.575745 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:00.578075 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:00.586269 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4de9ef92-aeb0-46c2-9d7c-346e4d701c8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.168669 Sep 09 12:18:00.586838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 494/1021] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:00 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:01.610156 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:01.610780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:01.613576 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=27 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:01.619244 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:01.619720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:01.620146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:01.621079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:01.621527 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:01.621942 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:01.624861 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=79 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:01.766556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:01.774836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-bb8ef523-4777-4b9f-86c9-c7250b2eb18d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.168668 Sep 09 12:18:01.775417 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 528/1022] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:01 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:02.799513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:02.800126 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:02.802680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=29 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:02.809239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:02.809721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:02.810181 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:02.810873 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:02.811323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:02.811751 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:02.961559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:02.969812 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9261e1c3-9fed-4d9d-86b4-4696f5a59d99 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.175095 Sep 09 12:18:02.970415 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 495/1023] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:02 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:03.992603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:03.993208 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:03.999823 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:04.000301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:04.000729 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:04.001409 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:04.001853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:04.002306 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:04.141089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:04.149932 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d36d6a5b-5033-423c-8018-f0abb8ef1f85 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.161083 Sep 09 12:18:04.150467 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 529/1024] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:03 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:05.173492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:05.174039 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:05.181290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:05.181778 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:05.182240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:05.182943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:05.183407 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:05.183836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:05.329462 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:05.337840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8aa9dc54-64e0-4f1a-878e-2359ba55ca97 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1755 microversion: 2.1 time: 0.168416 Sep 09 12:18:05.338445 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 496/1025] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:05 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:06.361866 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:06.362514 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:06.370397 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:06.371280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:06.371916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:06.372902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:06.373413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:06.373834 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:06.537319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:06.547785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e3c70568-5e15-4b29-8a00-653c8b228716 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1758 microversion: 2.1 time: 0.190025 Sep 09 12:18:06.548737 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 530/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:06 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:07.126288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf27ca3b-e471-4ced-b1d0-489176386a3a", "device": "/dev/sdb"}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:07.129422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:07.136322 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.136817 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.137254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.138009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:07.138950 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:07.139495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:07.429662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e25189d6-224e-4a2d-a5d4-bd36a8ba19b6 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "POST /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307084 Sep 09 12:18:07.435961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 497/1027] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:18:07 2022] POST /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:18.303189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=5 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:18.303869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=17 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:18.492522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-25f4ea72-bae4-4a37-a7df-97df896052d4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Action: 'create', calling method: .version_select at 0x7ff2d9165c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-694532186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeiNeVW/K+HDgDjM4dNG+Xytl2lKbhE8Q4JpuCPe/foMDl3dUJLryDZqdKBKOR3lV5vaNuys9hqXAYewPS3DSMRSkJxvBL7W50mUsGsSbwJXhEfW5iS/qSnrdkuHPTzLg=="}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:18.509161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-25f4ea72-bae4-4a37-a7df-97df896052d4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Getting quotas for project 26d88da533a4432a97eb9644ce21fcfe. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:18:18.513279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-25f4ea72-bae4-4a37-a7df-97df896052d4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Getting quotas for user 7e4d42a3879f4ec2b422f4bc8dd2dea9 and project 26d88da533a4432a97eb9644ce21fcfe. Resources: {'key_pairs'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:18:18.539047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-25f4ea72-bae4-4a37-a7df-97df896052d4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.241027 Sep 09 12:18:18.539770 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 531/1028] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:18:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:46.931857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:46.932427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:46.934976 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=5 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:46.935649 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:46.937136 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:18:46.937348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:18:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4/os-volume_attachments/bf27ca3b-e471-4ced-b1d0-489176386a3a (ip 10.222.0.62) !!! Sep 09 12:18:46.948889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:46.949387 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:46.949823 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:46.950561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:46.951015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:46.951443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:47.036335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lazy-loading 'services' on Instance uuid c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:18:47.107356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39477355-a385-47ed-a2a9-c07ff74eeea4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4/os-volume_attachments/bf27ca3b-e471-4ced-b1d0-489176386a3a" status: 202 len: 0 microversion: 2.1 time: 0.180184 Sep 09 12:18:47.107962 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 498/1029] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:18:46 2022] DELETE /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4/os-volume_attachments/bf27ca3b-e471-4ced-b1d0-489176386a3a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:18:48.246907 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:48.248109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:48.250286 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:48.251303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:18:48.259253 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:48.259991 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:48.260428 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:48.261321 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:48.261781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:48.262236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:48.288948 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:18:48.369192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4fbb7463-7c5e-4108-aa53-ea5e13a99236 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 204 len: 0 microversion: 2.1 time: 0.126580 Sep 09 12:18:48.369785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 532/1030] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:18:48 2022] DELETE /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:18:48.381048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:48.382240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:48.389401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:48.389972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:48.390613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:48.391449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:48.391967 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:48.392531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:48.531077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:48.538742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ebf40dcc-f0b0-47b3-afd6-675f1d5c4085 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1514 microversion: 2.1 time: 0.162867 Sep 09 12:18:48.539302 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 499/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:48 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:49.564094 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:49.564833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:49.572477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:49.572969 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:49.573415 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:49.574141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:49.574599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:49.575048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:49.716531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:49.724431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3bd45403-60a8-43d5-b4e4-895d6c86333f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1514 microversion: 2.1 time: 0.165789 Sep 09 12:18:49.725011 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 533/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:49 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:50.747765 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:50.748430 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:50.754795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:50.755278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:50.755718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:50.756403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:50.756860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:50.757283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:50.889931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:18:50.898682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e24dc9c4-5b41-4b6d-9762-4adad47b87b1 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 200 len: 1514 microversion: 2.1 time: 0.155048 Sep 09 12:18:50.899263 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 500/1033] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:50 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:18:51.311963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-7e6f59a7-5f4f-41fe-a344-cce40c340627 req-6ae73abe-62e4-4593-b5be-66da8846c766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c011eb80-e0e3-4edb-b79d-bec7d92dfbf4", "name": "network-vif-deleted", "tag": "45530925-4487-4700-9412-2c1abc97107c"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:18:51.322694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7e6f59a7-5f4f-41fe-a344-cce40c340627 req-6ae73abe-62e4-4593-b5be-66da8846c766 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:51.323176 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7e6f59a7-5f4f-41fe-a344-cce40c340627 req-6ae73abe-62e4-4593-b5be-66da8846c766 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:51.323608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-7e6f59a7-5f4f-41fe-a344-cce40c340627 req-6ae73abe-62e4-4593-b5be-66da8846c766 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:51.336305 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-7e6f59a7-5f4f-41fe-a344-cce40c340627 req-6ae73abe-62e4-4593-b5be-66da8846c766 service nova] Creating event network-vif-deleted:45530925-4487-4700-9412-2c1abc97107c for instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 on hv-cinder-85221 Sep 09 12:18:51.342631 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-7e6f59a7-5f4f-41fe-a344-cce40c340627 req-6ae73abe-62e4-4593-b5be-66da8846c766 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092715 Sep 09 12:18:51.343232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 534/1034] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:18:51.922995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:18:51.923599 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: c011eb80-e0e3-4edb-b79d-bec7d92dfbf4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:18:51.930143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:51.930641 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:51.931082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:51.931889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:18:51.932437 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:18:51.932883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:18:51.946716 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] HTTP exception thrown: Instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 could not be found. Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Request method failure captured: Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 HTTP/1.1 Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGy68-n6IfpeMzV_CQWHUFUNdRQ82qCiAlGhzHDoAmaLDkFvula1SwR2FwMbSsNTMWXUfQivRSE5MgpTtVJ7pMnxqIaa-zXRS49RTgm7J3MlwSsAWCCuYRuVJmV3ALKzxS2Ax-NhyWpR4IKu79WkumlISPZ8uxBsjpyurqikJ0AUY42M Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 770c076806c64cd78d35f095ee489bcf Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesSnapshotTestJSON-799114797 Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:18:51.948376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/770c076806c64cd78d35f095ee489bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_770c076806c64cd78d35f095ee489bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/770c076806c64cd78d35f095ee489bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/770c076806c64cd78d35f095ee489bcf"}]}] Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesSnapshotTestJSON-799114797 Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 770c076806c64cd78d35f095ee489bcf Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-799114797 Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesSnapshotTestJSON-799114797-project Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: f849563115ec4a4e859a7395a03a561a Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesSnapshotTestJSON-799114797-project Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 could not be found. Sep 09 12:18:51.950078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'c011eb80-e0e3-4edb-b79d-bec7d92dfbf4'} Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 could not be found. Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:18:51.951173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 could not be found. Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 could not be found. Sep 09 12:18:51.952513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:18:51.953709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Returning 404 to user: Instance c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:18:51.953709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-16c2299d-a623-4997-b7fb-ca9c4ad8469f tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4" status: 404 len: 111 microversion: 2.1 time: 0.031145 Sep 09 12:18:51.953709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 501/1035] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:18:51 2022] GET /compute/v2.1/servers/c011eb80-e0e3-4edb-b79d-bec7d92dfbf4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:02.265429 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1923723721", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-694532186", "security_groups": [{"name": "tempest-secgroup-smoke-319146479"}], "networks": [{"uuid": "487f142c-0565-49b0-9cd6-85d558b806f5"}], "block_device_mapping_v2": [{"uuid": "19caba00-4161-4e8d-838b-e1215c504ef2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:02.276072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:02.276726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:02.382711 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] validate_networks() for [('487f142c-0565-49b0-9cd6-85d558b806f5', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:19:02.896304 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:19:02.897103 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:19:02.898842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:19:02.899260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:19:02.900041 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:19:02.910192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:02.910703 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:02.911141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:02.911846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:02.912293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:02.912708 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:02.930624 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Getting quotas for project 26d88da533a4432a97eb9644ce21fcfe. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:19:02.935162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Getting quotas for user 7e4d42a3879f4ec2b422f4bc8dd2dea9 and project 26d88da533a4432a97eb9644ce21fcfe. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:19:02.993447 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:19:02.995797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19caba00-4161-4e8d-838b-e1215c504ef2',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:19:03.135109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ecb8471-12c0-4f02-9aa6-d04a21574805 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.873752 Sep 09 12:19:03.135622 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 535/1036] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:19:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:19:03.147115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-df334299-8d57-4680-b750-ad8cd77f05cf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:03.148230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-df334299-8d57-4680-b750-ad8cd77f05cf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:03.150776 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:03.151538 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:03.206277 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-df334299-8d57-4680-b750-ad8cd77f05cf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:03.213117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-df334299-8d57-4680-b750-ad8cd77f05cf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1088 microversion: 2.1 time: 0.069865 Sep 09 12:19:03.213682 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 502/1037] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:03 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:04.237588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:04.238224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:04.245029 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.245559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.245929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:04.246642 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:04.247341 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:04.247756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:04.309088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:04.318064 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7585336-ed46-4bc5-aa32-dcf54087f8c4 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1138 microversion: 2.1 time: 0.084831 Sep 09 12:19:04.318660 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 536/1038] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:04 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:05.342083 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:05.342727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:05.350234 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:05.350739 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:05.351214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:05.351923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:05.352380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:05.352808 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:05.413613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:05.421334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ebeb30b6-4733-4d50-a20d-214e9cca9066 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1130 microversion: 2.1 time: 0.083172 Sep 09 12:19:05.421939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 503/1039] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:05 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1130 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:06.443329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:06.443940 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:06.450963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:06.451443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:06.451875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:06.452555 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:06.453003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:06.453421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:06.517522 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:06.525212 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10d603b6-bc11-4192-9c01-a786aec2f26c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1130 microversion: 2.1 time: 0.085766 Sep 09 12:19:06.525785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 537/1040] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:06 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1130 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:07.547252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:07.547806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:07.554397 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:07.554871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:07.555301 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:07.555983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:07.556435 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:07.556857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:07.619160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:07.627073 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9cc9b7df-0287-4858-b49d-e3b8f40e466e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1194 microversion: 2.1 time: 0.083790 Sep 09 12:19:07.627638 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 504/1041] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:07 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:08.100598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-567774388", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452", "networks": [{"uuid": "8714ac38-13f0-4ec7-82b2-7e59c29180b4"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:08.157469 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] validate_networks() for [('8714ac38-13f0-4ec7-82b2-7e59c29180b4', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:19:08.650929 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:08.652402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:08.663674 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.664257 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.664935 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:08.665846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.668778 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.669262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:08.811357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:19:08.812016 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:19:08.812568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:19:08.813048 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:19:08.813549 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:19:08.843873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.844717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.845340 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:08.846161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:08.846620 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:08.847042 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:08.888477 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:08.890846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Getting quotas for project 770c076806c64cd78d35f095ee489bcf. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:19:08.895582 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Getting quotas for user f849563115ec4a4e859a7395a03a561a and project 770c076806c64cd78d35f095ee489bcf. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:19:08.896376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-54131699-eb1c-4d46-8bbb-adb9f50a3f55 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1271 microversion: 2.1 time: 0.249389 Sep 09 12:19:08.896893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 505/1042] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:08 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1271 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:08.910208 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:19:08.912730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:19:08.968535 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-34139334-69c1-4bf9-a556-63303562c867 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871420 Sep 09 12:19:08.977341 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 538/1043] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:19:08.987203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d5fdc014-69d6-48dd-ab09-caa839a01c81 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:08.989598 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d5fdc014-69d6-48dd-ab09-caa839a01c81 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:09.044815 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d5fdc014-69d6-48dd-ab09-caa839a01c81 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:09.051915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d5fdc014-69d6-48dd-ab09-caa839a01c81 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1218 microversion: 2.1 time: 0.073621 Sep 09 12:19:09.052796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 506/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:08 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:09.575115 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-eba8c262-fb0b-48db-a915-a99883df9181 req-4543006d-e330-4321-bab2-2d7f437ec6ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2db2b0-281b-4146-bec3-2f5dd0c00f25", "tag": "6f011037-d5e0-415c-a540-c8e479778a5f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:09.589561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eba8c262-fb0b-48db-a915-a99883df9181 req-4543006d-e330-4321-bab2-2d7f437ec6ec service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:09.590040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eba8c262-fb0b-48db-a915-a99883df9181 req-4543006d-e330-4321-bab2-2d7f437ec6ec service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:09.590495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-eba8c262-fb0b-48db-a915-a99883df9181 req-4543006d-e330-4321-bab2-2d7f437ec6ec service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:09.601754 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-eba8c262-fb0b-48db-a915-a99883df9181 req-4543006d-e330-4321-bab2-2d7f437ec6ec service nova] Creating event network-changed:6f011037-d5e0-415c-a540-c8e479778a5f for instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 on hv-cinder-85221 Sep 09 12:19:09.606843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-eba8c262-fb0b-48db-a915-a99883df9181 req-4543006d-e330-4321-bab2-2d7f437ec6ec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036889 Sep 09 12:19:09.607587 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 539/1045] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:09.923795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:09.924365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:09.930874 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:09.931380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:09.931822 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:09.932525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:09.932983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:09.933413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:10.074703 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:10.077119 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:10.077825 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:10.083910 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:10.084399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:10.084535 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0b643bc-2096-46c2-b652-554dba593e4a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.164546 Sep 09 12:19:10.084836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:10.086162 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 507/1046] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:09 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:10.086316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:10.086564 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:10.086989 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:10.167189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:10.175293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-35e6c4b9-dcbd-4d60-bc06-59620b2b644d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1270 microversion: 2.1 time: 0.102355 Sep 09 12:19:10.175912 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 540/1047] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:10 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:11.108424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:11.109034 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:11.115395 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:11.115876 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:11.116918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:11.117607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:11.118055 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:11.118501 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:11.204734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:11.205453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:11.213057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:11.213560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:11.214071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:11.214907 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:11.215545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:11.215919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:11.281059 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:11.290478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-b2811818-db9a-483e-931d-b67394faee3a tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.185880 Sep 09 12:19:11.292396 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 508/1048] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:11 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:11.376329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:11.384386 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-287928a7-4626-4fb3-b365-3510c59800e0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.183534 Sep 09 12:19:11.384956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 541/1049] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:11 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:12.314700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:12.315295 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:12.322148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:12.322625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:12.323054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:12.323742 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:12.324190 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:12.324607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:12.417901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a28613d1-e1fc-4809-8ff5-0ef377986e69 req-4532e7e0-c145-4775-9dfc-72d84abe7b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57700c6b-f766-4728-a26d-63cc7dbd20e9", "tag": "24bcd331-ebce-4221-b474-67593e15be79"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:12.429188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a28613d1-e1fc-4809-8ff5-0ef377986e69 req-4532e7e0-c145-4775-9dfc-72d84abe7b57 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:12.429684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a28613d1-e1fc-4809-8ff5-0ef377986e69 req-4532e7e0-c145-4775-9dfc-72d84abe7b57 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:12.430165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a28613d1-e1fc-4809-8ff5-0ef377986e69 req-4532e7e0-c145-4775-9dfc-72d84abe7b57 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:12.441619 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a28613d1-e1fc-4809-8ff5-0ef377986e69 req-4532e7e0-c145-4775-9dfc-72d84abe7b57 service nova] Creating event network-changed:24bcd331-ebce-4221-b474-67593e15be79 for instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 on hv-cinder-85221 Sep 09 12:19:12.446688 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a28613d1-e1fc-4809-8ff5-0ef377986e69 req-4532e7e0-c145-4775-9dfc-72d84abe7b57 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221121 Sep 09 12:19:12.447355 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 509/1050] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:12.452951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:12.453656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:12.460443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:12.460936 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:12.461374 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:12.462084 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:12.462571 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:12.462996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:12.476332 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:12.484950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ac0426f6-e3db-46ff-a834-547c043ae0bf tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.173899 Sep 09 12:19:12.485521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 542/1051] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:12 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:12.690596 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:12.698457 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5a521e8b-5278-4ca8-93c4-ff79f82d25cc tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.249857 Sep 09 12:19:12.699029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 510/1052] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:12 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:13.409353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-761036295", "imageRef": "bd0295dd-52cd-4391-8f02-2e0d9413aadb", "flavorRef": "452"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:13.461681 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] validate_networks() for None {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:19:13.507504 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:13.508215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:13.515288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:13.515860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:13.516304 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:13.517007 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:13.517465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:13.517894 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:13.662732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:13.671243 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-85bd240f-1471-4651-bae4-d2ae3f936681 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.168139 Sep 09 12:19:13.671816 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 511/1053] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:13 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:13.721789 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:13.722427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:13.729326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:13.729812 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:13.730287 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:13.730986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:13.731440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:13.731855 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:13.874145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:13.887411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ede6d817-92dc-4cbf-9caf-9ba3ab6dc460 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.169235 Sep 09 12:19:13.888464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 512/1054] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:13 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:14.002454 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:19:14.002873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:19:14.003373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:19:14.003784 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:19:14.004201 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:19:14.012829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:14.013303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:14.013731 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:14.014481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:14.014930 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:14.015351 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:14.031997 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Getting quotas for project 781d68e5617d4fcd838836192767453e. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:19:14.035854 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Getting quotas for user 392ffc42301e4752beb3046b1ffca33f and project 781d68e5617d4fcd838836192767453e. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:19:14.047719 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:19:14.050036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd0295dd-52cd-4391-8f02-2e0d9413aadb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:19:14.094185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-db0347ed-1512-4731-a314-b95465924dd2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688475 Sep 09 12:19:14.094797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 543/1055] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:19:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:19:14.106325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5515b538-6d07-4e78-985e-3322ba1eb08e tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:14.107095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5515b538-6d07-4e78-985e-3322ba1eb08e tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:14.161041 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5515b538-6d07-4e78-985e-3322ba1eb08e tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:14.168938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5515b538-6d07-4e78-985e-3322ba1eb08e tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1214 microversion: 2.1 time: 0.066563 Sep 09 12:19:14.169514 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 513/1056] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:14 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:14.696133 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:14.696684 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:14.703315 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:14.703833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:14.704266 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:14.704956 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:14.705406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:14.705829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:14.834409 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:14.842088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-de83b299-5af3-49cc-a2f6-b03e75419b6d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.151037 Sep 09 12:19:14.842679 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 544/1057] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:14 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:14.912330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:14.912330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:14.919494 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:14.920218 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:14.920651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:14.921742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:14.922235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:14.922674 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:15.148078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:15.158082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0d0b0057-e805-4e59-901f-21a88a7970ed tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.251191 Sep 09 12:19:15.159820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 514/1058] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:14 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:15.191850 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:15.192806 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:15.199743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:15.200532 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:15.201030 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:15.201684 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:15.202167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:15.202798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:15.276045 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:15.285247 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5b2e2e5-dd62-4683-82e1-ea13716e9ea2 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1266 microversion: 2.1 time: 0.097551 Sep 09 12:19:15.286361 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 545/1059] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:15 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:15.864932 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:15.865532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:15.872957 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:15.873521 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:15.874049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:15.874881 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:15.875448 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:15.875941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:16.073981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:16.083169 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9784dc2e-0e7b-4177-9fd1-25ba61880b27 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.222157 Sep 09 12:19:16.083852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 515/1060] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:15 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:16.182863 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:16.183439 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:16.189786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:16.190309 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:16.190748 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:16.191482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:16.191942 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:16.192375 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:16.309752 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:16.310854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:16.317193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:16.317687 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:16.318383 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:16.319162 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:16.320288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:16.320725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:16.345344 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:16.363613 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a4a6e285-6835-4a74-8d9c-a23e59a222f5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.185188 Sep 09 12:19:16.364606 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 546/1061] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:16 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:16.562584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:16.571825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dbc6239c-c402-4f93-9d01-6cbd3faec6fe tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1272 microversion: 2.1 time: 0.266120 Sep 09 12:19:16.572947 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 516/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:16 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:17.106738 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:17.107559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:17.113547 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.114044 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.114574 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.115277 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.115734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.116665 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.248871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:17.256628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-72a3f8e4-0122-4b36-94d8-7ee28d67447f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.153811 Sep 09 12:19:17.257203 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 547/1063] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:17 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:17.387410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:17.388026 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:17.394465 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.394946 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.395382 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.396069 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.396525 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.396948 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.524961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:17.532490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-69136be1-d422-4565-a6c2-f770cc015dd5 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.148922 Sep 09 12:19:17.533054 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 517/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:17 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:17.596505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:17.597104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:17.603217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.603694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.604124 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.604799 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:17.605246 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:17.605662 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:17.739717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:17.748793 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c1906317-7240-4079-8208-d67c89a5f739 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.156126 Sep 09 12:19:17.749361 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 548/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:17 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:18.279466 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:18.280097 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:18.286107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.286623 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.287065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.288259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.288712 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.289138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.430868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:18.438559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-479f6470-3cb5-4ed0-a9dd-0740c01f5090 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.162948 Sep 09 12:19:18.439122 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 518/1066] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:18 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:18.555266 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:18.555889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:18.562622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.563276 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.564749 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-9f315cb0-47dd-4479-98f3-d9fd6678f023 req-e5d2b3f2-49be-461c-8f19-e3dc67f37b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57700c6b-f766-4728-a26d-63cc7dbd20e9", "name": "network-vif-plugged", "status": "completed", "tag": "24bcd331-ebce-4221-b474-67593e15be79"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:18.571542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.572357 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.572898 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.573770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.574598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9f315cb0-47dd-4479-98f3-d9fd6678f023 req-e5d2b3f2-49be-461c-8f19-e3dc67f37b09 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.575082 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9f315cb0-47dd-4479-98f3-d9fd6678f023 req-e5d2b3f2-49be-461c-8f19-e3dc67f37b09 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.575518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-9f315cb0-47dd-4479-98f3-d9fd6678f023 req-e5d2b3f2-49be-461c-8f19-e3dc67f37b09 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.587289 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-9f315cb0-47dd-4479-98f3-d9fd6678f023 req-e5d2b3f2-49be-461c-8f19-e3dc67f37b09 service nova] Creating event network-vif-plugged:24bcd331-ebce-4221-b474-67593e15be79 for instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 on hv-cinder-85221 Sep 09 12:19:18.592205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-9f315cb0-47dd-4479-98f3-d9fd6678f023 req-e5d2b3f2-49be-461c-8f19-e3dc67f37b09 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094708 Sep 09 12:19:18.592804 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 549/1067] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:18.703994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:18.712214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-adb23c4b-74e8-4123-aefb-9edde79caa16 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.160986 Sep 09 12:19:18.712781 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 519/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:18 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:18.771813 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:18.772928 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:18.779065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.779540 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.779971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.780651 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:18.781105 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:18.781526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:18.910867 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:18.918553 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2f0d9679-0308-4a2b-a8d1-0f41a7390846 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.151016 Sep 09 12:19:18.919140 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 550/1069] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:18 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:19.461485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:19.462104 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:19.468556 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.469040 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.469478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:19.470203 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.470668 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.471095 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:19.602403 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:19.610097 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0256c8c-6add-46af-bd7f-bfb0c8fae4e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.152481 Sep 09 12:19:19.610684 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 520/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:19 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:19.735965 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:19.736787 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:19.745461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.745947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.746406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:19.747356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.747807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.748232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:19.879438 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:19.887291 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e51e722e-f412-4c97-bf11-14b6d53760b0 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.155793 Sep 09 12:19:19.887865 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 551/1071] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:19 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:19.940658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:19.941305 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:19.947316 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.947800 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.948238 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:19.948925 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:19.949381 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:19.949807 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:20.090369 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:20.097901 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-3f51bb96-673e-4af2-b642-48e7bc61ee43 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.161122 Sep 09 12:19:20.098498 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 521/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:19 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:20.634531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:20.635154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:20.641456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:20.641945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:20.642411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:20.643111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:20.643563 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:20.644060 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:20.773638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:20.781371 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-869e43b3-f7af-47bc-b83b-98c934a1b5b1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.151352 Sep 09 12:19:20.781938 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 552/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:20 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:20.910903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:20.911523 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:20.917984 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:20.918572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:20.919012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:20.919703 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:20.920159 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:20.920585 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:20.924661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:21.052911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:21.061184 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ea0dd5ed-b28d-493a-81f9-262e03e1175d tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.154413 Sep 09 12:19:21.061760 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 522/1074] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:20 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:21.121381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:21.121986 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:21.128163 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:21.128641 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:21.129072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:21.129755 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:21.130229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:21.130640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:21.257496 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:21.265138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-02c099c8-889e-4a55-a792-b17c6cb88757 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.147659 Sep 09 12:19:21.265702 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 553/1075] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:21 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:21.803173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:21.804401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:21.810532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:21.811022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:21.811461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:21.812160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:21.812618 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:21.813044 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.040971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:22.048806 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-96beffb0-c8c0-4ff7-8518-914e47b9e370 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.249431 Sep 09 12:19:22.049384 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 523/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:21 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:22.083843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:22.084430 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:22.091138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:22.091619 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:22.092051 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.092739 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:22.093189 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:22.093607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.230988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:22.234545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=100 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:22.240097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-437013ce-e96e-4bf7-bb4d-bc4aefcbbf67 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.160020 Sep 09 12:19:22.240929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 554/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:22 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:22.288812 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:22.289388 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:22.295578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:22.295820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:22.296260 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.296996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:22.297462 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:22.297890 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.486406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:22.495929 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a94d0fdf-8d0a-4490-878b-c96c8cbdc6de tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.212240 Sep 09 12:19:22.496699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 524/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:22 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:22.523987 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c5a6610a-4c20-4189-8739-5d427753a22a req-646d404f-a18a-4e1b-9af2-937168ae1513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3893f9-2d55-4538-8a5b-b074a808b5b4", "tag": "04ccd7d7-54b2-4618-b4e3-2c5c996e12b3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:22.534572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a6610a-4c20-4189-8739-5d427753a22a req-646d404f-a18a-4e1b-9af2-937168ae1513 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:22.535057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a6610a-4c20-4189-8739-5d427753a22a req-646d404f-a18a-4e1b-9af2-937168ae1513 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:22.535489 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c5a6610a-4c20-4189-8739-5d427753a22a req-646d404f-a18a-4e1b-9af2-937168ae1513 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:22.548294 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c5a6610a-4c20-4189-8739-5d427753a22a req-646d404f-a18a-4e1b-9af2-937168ae1513 service nova] Creating event network-changed:04ccd7d7-54b2-4618-b4e3-2c5c996e12b3 for instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 on hv-cinder-85221 Sep 09 12:19:22.554492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c5a6610a-4c20-4189-8739-5d427753a22a req-646d404f-a18a-4e1b-9af2-937168ae1513 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035160 Sep 09 12:19:22.555112 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 555/1079] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:23.072733 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:23.073309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:23.079662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.080193 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.080589 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.081278 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.081733 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.082214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.213142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:23.220802 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f26fbb8f-f5f3-4ee9-8f01-51bb0f29286e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.152723 Sep 09 12:19:23.221371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 525/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:23 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:23.264127 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:23.264822 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:23.271393 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.271872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.272388 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.273097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.273545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.273964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.417489 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:23.425840 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-05f56f39-6684-4b22-abd7-0a0bdac3a662 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1318 microversion: 2.1 time: 0.165921 Sep 09 12:19:23.426444 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 556/1081] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:23 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:23.517973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:23.518608 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:23.524592 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.525064 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.525496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.526199 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:23.526656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:23.527069 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:23.655463 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:23.663571 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1ee412d5-c70f-46c8-9c46-7b3737a530b0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.148913 Sep 09 12:19:23.664162 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 526/1082] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:23 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:24.242799 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:24.243412 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:24.245714 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:24.246417 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=18 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:24.253311 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.253798 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.254255 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.254958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.255588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.255820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.406647 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:24.415184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6395b18c-8e0c-401a-82bd-8acfd86e172e tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.176231 Sep 09 12:19:24.415912 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 557/1083] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:24 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:24.449637 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:24.450387 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:24.452970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=6 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:24.459628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.460009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.460583 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.461379 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.462065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.462585 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.604208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:24.612447 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9a87e7d-86b6-4467-8c6b-82fbed79c730 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1508 microversion: 2.1 time: 0.166573 Sep 09 12:19:24.613041 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 527/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:24 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:24.636957 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd139f68-6e91-4526-af8e-b9edd4cc97d7", "device": "/dev/sdb"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:24.640076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:24.646560 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.647052 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.647511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.648208 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.648661 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.649079 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.687009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:24.687595 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:24.695859 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.696508 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.696954 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.697661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:24.698148 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:24.698569 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:24.829138 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:24.837213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dd767427-d6ae-4b8f-bd61-5f4b42583fff tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.154324 Sep 09 12:19:24.837774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 528/1085] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:24 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:25.439028 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:25.439644 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:25.445587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.446060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.446524 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.447216 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.448094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.448094 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.577517 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:25.585791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1da5a08f-be59-4f6d-b554-f19730fae195 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.150619 Sep 09 12:19:25.586437 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 529/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:25 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:25.860256 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:25.860871 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:25.867335 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.867824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.868272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:25.868967 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:25.869428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:25.869857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:26.007926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:26.015760 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4896be05-d020-4ed6-9284-e1ed86fb4a1a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.159508 Sep 09 12:19:26.016326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 530/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:25 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:26.508717 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-aa5d7631-b574-4118-aca1-dcddd7ccfd57 req-c87dfd73-7573-46f0-b5ab-17731cfc2809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2db2b0-281b-4146-bec3-2f5dd0c00f25", "name": "network-vif-plugged", "status": "completed", "tag": "6f011037-d5e0-415c-a540-c8e479778a5f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:26.519110 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aa5d7631-b574-4118-aca1-dcddd7ccfd57 req-c87dfd73-7573-46f0-b5ab-17731cfc2809 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:26.519865 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aa5d7631-b574-4118-aca1-dcddd7ccfd57 req-c87dfd73-7573-46f0-b5ab-17731cfc2809 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:26.520194 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-aa5d7631-b574-4118-aca1-dcddd7ccfd57 req-c87dfd73-7573-46f0-b5ab-17731cfc2809 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:26.532270 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-aa5d7631-b574-4118-aca1-dcddd7ccfd57 req-c87dfd73-7573-46f0-b5ab-17731cfc2809 service nova] Creating event network-vif-plugged:6f011037-d5e0-415c-a540-c8e479778a5f for instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 on hv-cinder-85221 Sep 09 12:19:26.537304 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-aa5d7631-b574-4118-aca1-dcddd7ccfd57 req-c87dfd73-7573-46f0-b5ab-17731cfc2809 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033410 Sep 09 12:19:26.538453 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 531/1088] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:19:26.609376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:26.610289 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:26.617258 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:26.617742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:26.618207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:26.618911 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:26.619372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:26.619803 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:26.755743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:26.764145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d3b1366a-f396-4cdd-b99b-1f16f26d2362 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.159168 Sep 09 12:19:26.764744 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 532/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:26 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:27.039288 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:27.039972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:27.046197 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:27.046692 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:27.047132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:27.047835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:27.048289 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:27.048714 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:27.183749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:27.191544 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5693c233-79ce-413a-b162-fa73012087bc tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.156943 Sep 09 12:19:27.192102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 533/1090] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:27 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:27.789790 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:27.791167 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:27.800493 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:27.801202 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:27.801825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:27.804145 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:27.804813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:27.805285 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:27.844933 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fe79066d-2faa-4744-9816-f9a260737ba8 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "POST /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.211901 Sep 09 12:19:27.846528 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 558/1091] 10.222.0.62 () {60 vars in 1323 bytes} [Fri Sep 9 12:19:24 2022] POST /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9/os-volume_attachments => generated 194 bytes in 3214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:27.979124 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:27.987100 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4feef07-4431-4ca0-aa37-3e2bad853744 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.203157 Sep 09 12:19:27.987711 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 534/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:27 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:28.215667 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:28.216395 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:28.224423 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:28.224926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:28.225369 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:28.226638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:28.226638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:28.226958 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:28.369266 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:28.377589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ca24f35e-b049-4e0b-8644-2a8904753d05 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.166476 Sep 09 12:19:28.379304 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 559/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:28 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:29.010215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:29.010825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:29.017280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:29.017761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:29.018227 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:29.018921 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:29.019371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:29.019795 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:29.149865 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:29.157639 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c64ccf7-6cee-4a00-ae96-3368c89d2320 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1259 microversion: 2.1 time: 0.151225 Sep 09 12:19:29.170219 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 535/1094] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:29 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:29.404316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:29.404925 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:29.411321 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:29.411796 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:29.412224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:29.412947 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:29.413426 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:29.413846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:29.541132 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:29.548820 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fcac4149-0f70-4304-b08a-0ac0eb04bb47 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.148648 Sep 09 12:19:29.549389 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 560/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:29 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:30.181551 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:30.182233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:30.188837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.189356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.189792 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.190522 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.190972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.191402 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.363979 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:30.372671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-cb4fbe3d-2504-4aaf-8190-6103c383a258 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1443 microversion: 2.1 time: 0.195413 Sep 09 12:19:30.373237 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 536/1096] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:30 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1443 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:30.394794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:30.395405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:30.402602 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.403097 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.403534 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.404437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.405021 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.405413 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.561293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:30.573378 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:30.574232 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:30.581253 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.582653 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.586574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.590348 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.590904 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.592719 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-764276bf-5c6a-40aa-87dc-2f2a068995cb tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1443 microversion: 2.1 time: 0.201740 Sep 09 12:19:30.593220 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.598817 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 561/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:30 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1443 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:30.603539 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-a1df9909-1826-47ad-ac01-b1bc42d6e166 req-2b7f9511-2f65-469b-875b-76b3e245b33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3893f9-2d55-4538-8a5b-b074a808b5b4", "name": "network-vif-plugged", "status": "completed", "tag": "04ccd7d7-54b2-4618-b4e3-2c5c996e12b3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:30.624946 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:30.630859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1df9909-1826-47ad-ac01-b1bc42d6e166 req-2b7f9511-2f65-469b-875b-76b3e245b33c service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:30.631345 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1df9909-1826-47ad-ac01-b1bc42d6e166 req-2b7f9511-2f65-469b-875b-76b3e245b33c service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:30.631772 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-a1df9909-1826-47ad-ac01-b1bc42d6e166 req-2b7f9511-2f65-469b-875b-76b3e245b33c service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:30.663368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-a1df9909-1826-47ad-ac01-b1bc42d6e166 req-2b7f9511-2f65-469b-875b-76b3e245b33c service nova] Creating event network-vif-plugged:04ccd7d7-54b2-4618-b4e3-2c5c996e12b3 for instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 on hv-cinder-85221 Sep 09 12:19:30.669709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-a1df9909-1826-47ad-ac01-b1bc42d6e166 req-2b7f9511-2f65-469b-875b-76b3e245b33c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069407 Sep 09 12:19:30.671876 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 562/1098] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:30.845108 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:30.853059 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e7be7d86-2ea6-4400-8748-a9c3df2975c0 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.284654 Sep 09 12:19:30.853964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 537/1099] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:30 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:31.875836 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:31.876670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:31.884147 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.884638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.885076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:31.885776 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:31.886260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:31.886685 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:32.024217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:32.031941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b15a995a-e2a0-4fa2-9731-91a5cc6b8ab5 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1314 microversion: 2.1 time: 0.160611 Sep 09 12:19:32.032500 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 563/1100] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:31 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:19:32.780957 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-17ad2858-b0e7-4e55-82c2-8fb539634e92 req-e7d648be-eb98-4a8d-a0e6-a9170c4eb708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2db2b0-281b-4146-bec3-2f5dd0c00f25", "tag": "6f011037-d5e0-415c-a540-c8e479778a5f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:32.791725 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-17ad2858-b0e7-4e55-82c2-8fb539634e92 req-e7d648be-eb98-4a8d-a0e6-a9170c4eb708 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:32.792207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-17ad2858-b0e7-4e55-82c2-8fb539634e92 req-e7d648be-eb98-4a8d-a0e6-a9170c4eb708 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:32.792642 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-17ad2858-b0e7-4e55-82c2-8fb539634e92 req-e7d648be-eb98-4a8d-a0e6-a9170c4eb708 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:32.803984 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-17ad2858-b0e7-4e55-82c2-8fb539634e92 req-e7d648be-eb98-4a8d-a0e6-a9170c4eb708 service nova] Creating event network-changed:6f011037-d5e0-415c-a540-c8e479778a5f for instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 on hv-cinder-85221 Sep 09 12:19:32.809512 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-17ad2858-b0e7-4e55-82c2-8fb539634e92 req-e7d648be-eb98-4a8d-a0e6-a9170c4eb708 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032341 Sep 09 12:19:32.810458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 538/1101] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:33.055193 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:33.055785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:33.064950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.064950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.065375 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.066633 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.067090 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.067840 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.236353 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:33.244871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4b4c37d0-7cef-47d6-8507-ff24f8de20bd tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1463 microversion: 2.1 time: 0.193540 Sep 09 12:19:33.257142 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 564/1102] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:33 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1463 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:33.293750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:33.294597 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:33.297101 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=81 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:33.303559 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.304060 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.305074 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.306325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.307099 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.307869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.340318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:19:33.356078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=100 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:33.424442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-da669261-a2da-4143-a5b1-b44091642b0a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 204 len: 0 microversion: 2.1 time: 0.135152 Sep 09 12:19:33.426063 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 539/1103] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:33 2022] DELETE /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:19:33.435612 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:33.437431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:33.443604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.444471 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.445040 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.445812 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:33.446378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:33.446871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:33.582431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:33.590891 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9932b37e-a2c4-48a4-8795-469a966fca6a tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1469 microversion: 2.1 time: 0.160419 Sep 09 12:19:33.591475 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 565/1104] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:33 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:34.617957 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:34.618695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:34.625375 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:34.625862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:34.626328 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:34.627024 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:34.627852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:34.628280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:34.765420 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:34.773405 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70941626-d668-443b-8429-080dcf7cd6a4 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1469 microversion: 2.1 time: 0.161466 Sep 09 12:19:34.773973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 540/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:34 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1469 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:35.796902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:35.797521 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:35.804685 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:35.805180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:35.805618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:35.806342 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:35.806807 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:35.807232 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:35.946272 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:35.955198 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f02f0f5c-35c8-4928-87a1-488b1368d843 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1469 microversion: 2.1 time: 0.162045 Sep 09 12:19:35.956571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 566/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:35 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:36.344002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b00f6d24-728a-4a42-900d-67bf2f263204 req-75f8de04-771b-4cb3-8c7a-968286acaec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3893f9-2d55-4538-8a5b-b074a808b5b4", "name": "network-vif-deleted", "tag": "04ccd7d7-54b2-4618-b4e3-2c5c996e12b3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:36.354994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b00f6d24-728a-4a42-900d-67bf2f263204 req-75f8de04-771b-4cb3-8c7a-968286acaec1 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:36.355566 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b00f6d24-728a-4a42-900d-67bf2f263204 req-75f8de04-771b-4cb3-8c7a-968286acaec1 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:36.355996 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b00f6d24-728a-4a42-900d-67bf2f263204 req-75f8de04-771b-4cb3-8c7a-968286acaec1 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:36.370219 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b00f6d24-728a-4a42-900d-67bf2f263204 req-75f8de04-771b-4cb3-8c7a-968286acaec1 service nova] Creating event network-vif-deleted:04ccd7d7-54b2-4618-b4e3-2c5c996e12b3 for instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 on hv-cinder-85221 Sep 09 12:19:36.387565 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b00f6d24-728a-4a42-900d-67bf2f263204 req-75f8de04-771b-4cb3-8c7a-968286acaec1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047207 Sep 09 12:19:36.389106 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 541/1107] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:36.979695 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:36.980373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:36.986773 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:36.987256 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:36.987697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:36.988387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:36.988859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:36.989270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:37.021277 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:37.021756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:37.022206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:37.022678 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lazy-loading 'fault' on Instance uuid 3e3893f9-2d55-4538-8a5b-b074a808b5b4 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:19:37.063886 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '392ffc42301e4752beb3046b1ffca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781d68e5617d4fcd838836192767453e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:37.071986 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-54c56bd5-1260-431e-9f58-c0f287ba0034 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 200 len: 1304 microversion: 2.1 time: 0.096133 Sep 09 12:19:37.072556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 567/1108] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:36 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:38.096672 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:38.097384 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] [instance: 3e3893f9-2d55-4538-8a5b-b074a808b5b4] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:38.104223 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:38.104699 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:38.105130 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:38.105813 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:38.106300 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:38.106723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:38.119680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] HTTP exception thrown: Instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 could not be found. Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Request method failure captured: Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 HTTP/1.1 Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGy8_FbBt0HKqk_ohiRkfwNuM4hije4f4X13IeEOoZHiMkUxTXbllSNAmmExRAWF2mcifKWJuAT6Z03J5Y8d4j0MnBUPpUjEnq7mWwBo2AfqhZKVolwOc7OO2OldDNrJy2wBCkrOUCxi3ZflrShWWsq5JrMZ35WR6YQHBazxy4kt8Xjw Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 781d68e5617d4fcd838836192767453e Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-VolumesNegativeTest-189763091 Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:19:38.121327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/781d68e5617d4fcd838836192767453e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_781d68e5617d4fcd838836192767453e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/781d68e5617d4fcd838836192767453e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/781d68e5617d4fcd838836192767453e"}]}] Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-VolumesNegativeTest-189763091 Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 781d68e5617d4fcd838836192767453e Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-VolumesNegativeTest-189763091 Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-VolumesNegativeTest-189763091-project Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 392ffc42301e4752beb3046b1ffca33f Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-VolumesNegativeTest-189763091-project Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 could not be found. Sep 09 12:19:38.123313 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '3e3893f9-2d55-4538-8a5b-b074a808b5b4'} Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 could not be found. Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:38.124484 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 could not be found. Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 could not be found. Sep 09 12:19:38.126133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:38.127587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] Returning 404 to user: Instance 3e3893f9-2d55-4538-8a5b-b074a808b5b4 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:38.127587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2dab2206-c645-4723-ae9b-14b4cb264a35 tempest-VolumesNegativeTest-189763091 tempest-VolumesNegativeTest-189763091-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4" status: 404 len: 111 microversion: 2.1 time: 0.030784 Sep 09 12:19:38.127587 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 542/1109] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:38 2022] GET /compute/v2.1/servers/3e3893f9-2d55-4538-8a5b-b074a808b5b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:43.486252 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-20487833"}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:43.486827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:43.493486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:43.493971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:43.494435 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:43.495128 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:43.495592 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:43.496018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:43.625065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.network.security_group_api [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Removing security group b049384e-592a-4d88-a8d0-26e434c9e3b3 from port 78ddba5c-300e-4659-8539-78d51f625eb6 Sep 09 12:19:43.955154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3c719e85-218b-4a0c-9f98-bba5c05d8ad5 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/action" status: 202 len: 0 microversion: 2.1 time: 0.472686 Sep 09 12:19:43.958856 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 568/1110] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:19:43 2022] POST /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:19:43.971511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b203e151-3236-4974-8a65-ccd25986ade3 req-1045848a-551b-4c98-a851-8477abc1a9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0badf4d4-3bf8-42ce-889d-90e70dc1b058", "tag": "78ddba5c-300e-4659-8539-78d51f625eb6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:44.015770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b203e151-3236-4974-8a65-ccd25986ade3 req-1045848a-551b-4c98-a851-8477abc1a9a4 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:44.018814 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b203e151-3236-4974-8a65-ccd25986ade3 req-1045848a-551b-4c98-a851-8477abc1a9a4 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:44.019269 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b203e151-3236-4974-8a65-ccd25986ade3 req-1045848a-551b-4c98-a851-8477abc1a9a4 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:44.035449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b203e151-3236-4974-8a65-ccd25986ade3 req-1045848a-551b-4c98-a851-8477abc1a9a4 service nova] Creating event network-changed:78ddba5c-300e-4659-8539-78d51f625eb6 for instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 on hv-cinder-85221 Sep 09 12:19:44.042350 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b203e151-3236-4974-8a65-ccd25986ade3 req-1045848a-551b-4c98-a851-8477abc1a9a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076826 Sep 09 12:19:44.046156 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 543/1111] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:45.196650 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:45.197170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:45.203354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:45.203843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:45.204281 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:45.204981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:45.205435 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:45.205885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:45.287994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lazy-loading 'services' on Instance uuid 0badf4d4-3bf8-42ce-889d-90e70dc1b058 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:19:45.364442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6c48a5a5-7cf0-46b1-b5b6-c94bde0f1efa tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments/f7689dfc-d7c9-4286-82ea-ac0f0f9cd052" status: 202 len: 0 microversion: 2.1 time: 0.172220 Sep 09 12:19:45.365036 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 569/1112] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:19:45 2022] DELETE /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments/f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:19:45.376386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:45.378665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:45.385582 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:45.386068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:45.386540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:45.387235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:45.387693 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:45.388118 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:45.419020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-05d4fde4-0005-4702-a3d8-5fba424982be tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048424 Sep 09 12:19:45.420015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 544/1113] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:19:45 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:46.057846 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-f9fb7948-267b-4ebb-8fef-5ac144e86c95 req-cf3ddd4c-b313-4134-b7d6-3de24a50e1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0badf4d4-3bf8-42ce-889d-90e70dc1b058", "tag": "78ddba5c-300e-4659-8539-78d51f625eb6"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:46.069393 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f9fb7948-267b-4ebb-8fef-5ac144e86c95 req-cf3ddd4c-b313-4134-b7d6-3de24a50e1df service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:46.070597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f9fb7948-267b-4ebb-8fef-5ac144e86c95 req-cf3ddd4c-b313-4134-b7d6-3de24a50e1df service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:46.071405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-f9fb7948-267b-4ebb-8fef-5ac144e86c95 req-cf3ddd4c-b313-4134-b7d6-3de24a50e1df service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:46.083452 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-f9fb7948-267b-4ebb-8fef-5ac144e86c95 req-cf3ddd4c-b313-4134-b7d6-3de24a50e1df service nova] Creating event network-changed:78ddba5c-300e-4659-8539-78d51f625eb6 for instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 on hv-cinder-85221 Sep 09 12:19:46.090645 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-f9fb7948-267b-4ebb-8fef-5ac144e86c95 req-cf3ddd4c-b313-4134-b7d6-3de24a50e1df service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036902 Sep 09 12:19:46.091600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 570/1114] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:46.433246 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:46.435463 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:46.441836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:46.442366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:46.442801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:46.443486 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:46.443941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:46.444366 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:46.473738 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-960652ea-dd2e-4362-bfb2-8c8eb3983f7c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Sep 09 12:19:46.474205 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 545/1115] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:19:46 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:47.486970 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:47.489122 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:47.495965 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:47.496449 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:47.496884 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:47.497833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:47.498332 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:47.498758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:47.515102 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:19:47.531400 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c35ffb34-56de-4d54-98d0-c68c5d68ba70 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049446 Sep 09 12:19:47.531962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 571/1116] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:19:47 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:48.544143 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:48.546282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:48.553040 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:48.553527 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:48.554494 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:48.555200 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:48.555658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:48.556087 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:48.585327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-1bb603db-15f0-4168-8f7d-83c51ef57a27 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Sep 09 12:19:48.585879 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 546/1117] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:19:48 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:49.598338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:49.600595 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:49.607507 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:49.607983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:49.608406 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:49.609086 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:49.609531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:49.609949 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:49.639526 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-105acb3f-2235-4403-95fd-0501fb879632 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045365 Sep 09 12:19:49.640085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 572/1118] 10.222.0.62 () {58 vars in 1302 bytes} [Fri Sep 9 12:19:49 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 09 12:19:49.652119 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:49.652636 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:49.659153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:49.660263 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:49.660263 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:49.660824 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:49.661285 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:49.661709 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:49.738152 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] HTTP exception thrown: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 is not attached to volume f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Request method failure captured: Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: DELETE /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments/f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 HTTP/1.1 Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGy5L_EHATu9EZU-9bR-5loLrQJm1f0mR9wG5O5h7a5hRpl5XF5rmv0n8zIrH2xpUDR6QIrFm2sWU46rxlUnngnnhMlet45EQbrsPI1oIgcVFc5sji56WQZJnzf02ncrR03wcY57N4C-PPWafUI3iYayuGTjnT3da2HWTftc_-uJ69GQ Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 68a3919f2172442fa280c380a7bff271 Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestMinimumBasicScenario-1272692308 Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:19:49.740580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68a3919f2172442fa280c380a7bff271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68a3919f2172442fa280c380a7bff271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68a3919f2172442fa280c380a7bff271"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68a3919f2172442fa280c380a7bff271"}]}] Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestMinimumBasicScenario-1272692308 Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 68a3919f2172442fa280c380a7bff271 Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1272692308 Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-TestMinimumBasicScenario-1272692308-project Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: cb72d25947724d028d948292925258d9 Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestMinimumBasicScenario-1272692308-project Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:19:49.742016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 is not attached to volume f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'server_id': '0badf4d4-3bf8-42ce-889d-90e70dc1b058', 'id': 'f7689dfc-d7c9-4286-82ea-ac0f0f9cd052'} Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f7689dfc-d7c9-4286-82ea-ac0f0f9cd052. Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:49.742837 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 is not attached to volume f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 is not attached to volume f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:49.744427 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Returning 404 to user: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 is not attached to volume f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:49.745410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-17d6f617-f934-4fb4-8e89-971a4ac8fb8c tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments/f7689dfc-d7c9-4286-82ea-ac0f0f9cd052" status: 404 len: 154 microversion: 2.1 time: 0.095134 Sep 09 12:19:49.745410 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 547/1119] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:19:49 2022] DELETE /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058/os-volume_attachments/f7689dfc-d7c9-4286-82ea-ac0f0f9cd052 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:50.889520 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:50.890095 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:50.896546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:50.897028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:50.897465 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:50.898687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:50.899143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:50.899569 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:50.924601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:19:50.998581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-aec731f8-77e0-42d3-a05a-ba555be63cf1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 204 len: 0 microversion: 2.1 time: 0.112216 Sep 09 12:19:50.999247 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 573/1120] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:50 2022] DELETE /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:19:51.012295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:51.012931 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:51.019665 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:51.020175 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:51.020965 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:51.021990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:51.022474 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:51.023551 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:51.158428 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:51.166196 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-80438620-867a-4437-a8b8-b1525abcc35d tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1554 microversion: 2.1 time: 0.162061 Sep 09 12:19:51.166784 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 548/1121] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:51 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:52.189373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:52.190073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:52.197196 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:52.197681 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:52.198133 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:52.198829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:52.199280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:52.199700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:52.328073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:52.335756 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0bd3c369-55c2-4628-bf2b-fd142b43c710 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1554 microversion: 2.1 time: 0.150638 Sep 09 12:19:52.336411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 574/1122] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:52 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:52.526307 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:52.526815 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:52.532748 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:52.533224 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:52.533658 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:52.534360 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:52.534810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:52.535230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:52.613923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lazy-loading 'services' on Instance uuid 57700c6b-f766-4728-a26d-63cc7dbd20e9 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:19:52.685233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c8d9ccde-983d-4b9a-8f07-ef769b7e46b9 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9/os-volume_attachments/bd139f68-6e91-4526-af8e-b9edd4cc97d7" status: 202 len: 0 microversion: 2.1 time: 0.162754 Sep 09 12:19:52.685852 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 549/1123] 10.222.0.62 () {58 vars in 1416 bytes} [Fri Sep 9 12:19:52 2022] DELETE /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9/os-volume_attachments/bd139f68-6e91-4526-af8e-b9edd4cc97d7 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:19:53.358899 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:53.359515 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:53.366018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:53.366546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:53.366985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:53.367671 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:53.368153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:53.368578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:53.496229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:53.504121 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3425bf11-2f3d-44e2-adb3-81fb97fe3008 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1554 microversion: 2.1 time: 0.149087 Sep 09 12:19:53.504696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 575/1124] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:53 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:54.040233 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5b443048-9023-4a57-bbb8-a18b53fe526d req-19d17186-7038-415c-9d3d-9c4a3569ec75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0badf4d4-3bf8-42ce-889d-90e70dc1b058", "name": "network-vif-deleted", "tag": "78ddba5c-300e-4659-8539-78d51f625eb6"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:54.050926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5b443048-9023-4a57-bbb8-a18b53fe526d req-19d17186-7038-415c-9d3d-9c4a3569ec75 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.051398 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5b443048-9023-4a57-bbb8-a18b53fe526d req-19d17186-7038-415c-9d3d-9c4a3569ec75 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.051819 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5b443048-9023-4a57-bbb8-a18b53fe526d req-19d17186-7038-415c-9d3d-9c4a3569ec75 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:54.063556 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5b443048-9023-4a57-bbb8-a18b53fe526d req-19d17186-7038-415c-9d3d-9c4a3569ec75 service nova] Creating event network-vif-deleted:78ddba5c-300e-4659-8539-78d51f625eb6 for instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 on hv-cinder-85221 Sep 09 12:19:54.068523 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5b443048-9023-4a57-bbb8-a18b53fe526d req-19d17186-7038-415c-9d3d-9c4a3569ec75 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033494 Sep 09 12:19:54.069173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 550/1125] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:19:54.527875 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:54.528486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:54.535717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.536138 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.536657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:54.537352 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.537800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.538255 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:54.569261 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.569536 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.569963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:54.570435 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lazy-loading 'fault' on Instance uuid 0badf4d4-3bf8-42ce-889d-90e70dc1b058 {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:19:54.619310 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb72d25947724d028d948292925258d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68a3919f2172442fa280c380a7bff271', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:54.627270 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-43ca6f5b-e9c1-47db-9331-7d1b1d78f27f tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 200 len: 1349 microversion: 2.1 time: 0.103774 Sep 09 12:19:54.627847 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 576/1126] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:54 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:54.867784 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:54.868385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:54.874705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.875186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.875615 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:54.876294 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.876743 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.877160 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:54.906533 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:19:54.980458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f72c14e7-011e-41cf-9744-f23f1f038344 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "DELETE /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 204 len: 0 microversion: 2.1 time: 0.116413 Sep 09 12:19:54.981142 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 551/1127] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:19:54 2022] DELETE /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:19:54.989690 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:54.990336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:54.996313 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.996800 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.997233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:54.998260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:54.998715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:54.999141 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.131216 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:55.139570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f1c43894-4fb2-4d23-ae3d-4dbf4edb40a4 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1514 microversion: 2.1 time: 0.153706 Sep 09 12:19:55.140174 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 577/1128] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:54 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:55.651691 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:55.652399 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] [instance: 0badf4d4-3bf8-42ce-889d-90e70dc1b058] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:55.658943 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.659429 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.659868 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.660571 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:55.661033 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:55.661458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:55.674913 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] HTTP exception thrown: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 could not be found. Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Request method failure captured: Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 HTTP/1.1 Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGy5L_EHATu9EZU-9bR-5loLrQJm1f0mR9wG5O5h7a5hRpl5XF5rmv0n8zIrH2xpUDR6QIrFm2sWU46rxlUnngnnhMlet45EQbrsPI1oIgcVFc5sji56WQZJnzf02ncrR03wcY57N4C-PPWafUI3iYayuGTjnT3da2HWTftc_-uJ69GQ Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 68a3919f2172442fa280c380a7bff271 Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestMinimumBasicScenario-1272692308 Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:19:55.676578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68a3919f2172442fa280c380a7bff271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_68a3919f2172442fa280c380a7bff271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/68a3919f2172442fa280c380a7bff271"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/68a3919f2172442fa280c380a7bff271"}]}] Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestMinimumBasicScenario-1272692308 Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 68a3919f2172442fa280c380a7bff271 Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1272692308 Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-TestMinimumBasicScenario-1272692308-project Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: cb72d25947724d028d948292925258d9 Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestMinimumBasicScenario-1272692308-project Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 could not be found. Sep 09 12:19:55.678361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '0badf4d4-3bf8-42ce-889d-90e70dc1b058'} Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 could not be found. Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:55.679330 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 could not be found. Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 could not be found. Sep 09 12:19:55.681117 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:19:55.682597 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Returning 404 to user: Instance 0badf4d4-3bf8-42ce-889d-90e70dc1b058 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:55.682597 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c8881cf-f958-4ca6-85bc-f432057df258 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058" status: 404 len: 111 microversion: 2.1 time: 0.031234 Sep 09 12:19:55.682597 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 552/1129] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:55 2022] GET /compute/v2.1/servers/0badf4d4-3bf8-42ce-889d-90e70dc1b058 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:19:55.686872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ec7ac629-2e20-4c8f-94e7-ded09ef044e1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] Calling method '.version_select at 0x7ff2d95f7f70>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:55.707425 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ec7ac629-2e20-4c8f-94e7-ded09ef044e1 tempest-TestMinimumBasicScenario-1272692308 tempest-TestMinimumBasicScenario-1272692308-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030988953" status: 202 len: 0 microversion: 2.1 time: 0.024285 Sep 09 12:19:55.708047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 578/1130] 10.222.0.62 () {58 vars in 1272 bytes} [Fri Sep 9 12:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1030988953 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:19:56.163020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:56.163723 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:56.169759 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:56.170380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:56.170905 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:56.171675 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:56.172208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:56.172704 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:56.320053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:56.327849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-55c75204-91d7-4dba-aba7-8c9af7dd2747 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1514 microversion: 2.1 time: 0.168837 Sep 09 12:19:56.328493 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 553/1131] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:56 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:57.354900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:57.355545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:57.363082 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:57.364241 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:57.364241 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:57.364785 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:57.365240 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:57.365691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:57.497519 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f849563115ec4a4e859a7395a03a561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770c076806c64cd78d35f095ee489bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:19:57.506028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ff28be2f-97f0-42ed-a310-1b447a396e89 tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 200 len: 1514 microversion: 2.1 time: 0.159100 Sep 09 12:19:57.506640 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 579/1132] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:57 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:19:57.927087 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-9a8538f5-8298-47f2-8c30-b5de57664ca1 req-586363de-4853-495c-a53a-a1fe7abdd3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57700c6b-f766-4728-a26d-63cc7dbd20e9", "name": "network-vif-deleted", "tag": "24bcd331-ebce-4221-b474-67593e15be79"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:19:57.938367 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9a8538f5-8298-47f2-8c30-b5de57664ca1 req-586363de-4853-495c-a53a-a1fe7abdd3ba service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:57.939290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9a8538f5-8298-47f2-8c30-b5de57664ca1 req-586363de-4853-495c-a53a-a1fe7abdd3ba service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:57.940077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-9a8538f5-8298-47f2-8c30-b5de57664ca1 req-586363de-4853-495c-a53a-a1fe7abdd3ba service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:57.976400 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-9a8538f5-8298-47f2-8c30-b5de57664ca1 req-586363de-4853-495c-a53a-a1fe7abdd3ba service nova] Creating event network-vif-deleted:24bcd331-ebce-4221-b474-67593e15be79 for instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 on hv-cinder-85221 Sep 09 12:19:57.988511 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-9a8538f5-8298-47f2-8c30-b5de57664ca1 req-586363de-4853-495c-a53a-a1fe7abdd3ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064633 Sep 09 12:19:57.990519 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 554/1133] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:19:58.531973 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:19:58.533274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] [instance: 57700c6b-f766-4728-a26d-63cc7dbd20e9] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:19:58.542895 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:58.543792 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:58.544882 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:58.546432 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:19:58.547165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:19:58.547861 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:19:58.566027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] HTTP exception thrown: Instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 could not be found. Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Request method failure captured: Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 HTTP/1.1 Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGy68-n6IfpeMzV_CQWHUFUNdRQ82qCiAlGhzHDoAmaLDkFvula1SwR2FwMbSsNTMWXUfQivRSE5MgpTtVJ7pMnxqIaa-zXRS49RTgm7J3MlwSsAWCCuYRuVJmV3ALKzxS2Ax-NhyWpR4IKu79WkumlISPZ8uxBsjpyurqikJ0AUY42M Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 770c076806c64cd78d35f095ee489bcf Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-VolumesSnapshotTestJSON-799114797 Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:19:58.568146 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/770c076806c64cd78d35f095ee489bcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_770c076806c64cd78d35f095ee489bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/770c076806c64cd78d35f095ee489bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/770c076806c64cd78d35f095ee489bcf"}]}] Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-VolumesSnapshotTestJSON-799114797 Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 770c076806c64cd78d35f095ee489bcf Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-799114797 Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-VolumesSnapshotTestJSON-799114797-project Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: f849563115ec4a4e859a7395a03a561a Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-VolumesSnapshotTestJSON-799114797-project Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 could not be found. Sep 09 12:19:58.569904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': '57700c6b-f766-4728-a26d-63cc7dbd20e9'} Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 could not be found. Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:19:58.570923 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 could not be found. Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 could not be found. Sep 09 12:19:58.573038 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:19:58.575903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] Returning 404 to user: Instance 57700c6b-f766-4728-a26d-63cc7dbd20e9 could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:19:58.576967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-98ab6e22-d25a-4760-88f7-40a763378a0c tempest-VolumesSnapshotTestJSON-799114797 tempest-VolumesSnapshotTestJSON-799114797-project] 10.222.0.62 "GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9" status: 404 len: 111 microversion: 2.1 time: 0.050701 Sep 09 12:19:58.578012 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 580/1134] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:19:58 2022] GET /compute/v2.1/servers/57700c6b-f766-4728-a26d-63cc7dbd20e9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:22:02.007222 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f97fee8-8836-42ad-915f-2eefb6cc472d] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 12:22:02.007903 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:02.008659 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:02.009842 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:22:02.009986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:22:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25/action (ip 10.222.0.62) !!! Sep 09 12:22:02.011599 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 12:22:02.011746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:22:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25/action (ip 10.222.0.62) !!! Sep 09 12:22:02.019207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:22:02.019845 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:02.029951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:02.030478 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:02.030920 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:02.031620 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:02.032080 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:02.032510 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:02.057198 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.objects.instance [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lazy-loading 'flavor' on Instance uuid 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 {{(pid=120719) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:22:02.131285 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-95e18be6-d3a3-4740-8996-1dc44a42a484 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "POST /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25/action" status: 202 len: 0 microversion: 2.1 time: 0.125712 Sep 09 12:22:02.131882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 555/1135] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:22:02 2022] POST /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:22:02.139032 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:02.139930 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:22:02.140919 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:22:02.141224 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Fri Sep 9 12:22:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 (ip 10.222.0.62) !!! Sep 09 12:22:02.147929 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:02.148697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:02.163941 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:02.164424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:02.164857 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:02.165554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:02.166003 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:02.166448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:02.502378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:02.510152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f3a48a3a-d98a-48c8-b406-0db8c974667f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.373344 Sep 09 12:22:02.510726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 581/1136] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:02 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:03.535111 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:03.535820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:03.545016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:03.546298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:03.546747 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:03.547532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:03.548231 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:03.548991 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:03.553048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f97fee8-8836-42ad-915f-2eefb6cc472d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38060. Sep 09 12:22:03.747048 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:03.755986 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d149e310-0781-4a88-8d54-ec4afdc04fb0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.226859 Sep 09 12:22:03.756558 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 556/1137] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:03 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:04.779161 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:04.780293 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:04.786939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:04.787426 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:04.787860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:04.788546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:04.788996 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:04.789420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:04.918533 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:04.926873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-270e7d47-23be-43f4-b04c-6945146bec32 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.151755 Sep 09 12:22:04.927440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 582/1138] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:04 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:05.949581 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:05.950215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:05.956607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:05.957134 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:05.957577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:05.958297 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:05.958758 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:05.959185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:06.090662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:06.098703 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2bf733d2-6f37-4c37-9140-4dfc8cac265d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.152993 Sep 09 12:22:06.099312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 557/1139] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:05 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:07.122859 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:07.123915 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:07.130541 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:07.131027 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:07.131461 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:07.132155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:07.132608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:07.133032 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:07.265771 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:07.273380 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-10fed5e6-469f-4f0e-8712-ebd7c2244077 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.154481 Sep 09 12:22:07.273950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 583/1140] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:07 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:08.297224 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:08.297897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:08.304513 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:08.305005 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:08.305442 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:08.306173 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:08.306629 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:08.307051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:08.437734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:08.445737 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e1d9c7f-1fca-4160-9567-ce0008d2a5e5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.152792 Sep 09 12:22:08.446337 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 558/1141] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:08 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:09.469185 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:09.469796 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:09.476153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:09.476627 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:09.477057 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:09.477733 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:09.478222 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:09.478657 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:09.608274 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:09.615967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-50aad6a6-cd79-4b8e-9d2c-33a854826cd1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.151122 Sep 09 12:22:09.616542 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 584/1142] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:09 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:10.639657 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:10.640262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:10.646833 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:10.647320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:10.647758 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:10.648446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:10.648910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:10.649338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:10.780174 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:10.787938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a0c7e540-b0c8-43f3-be85-2101a954a485 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.152189 Sep 09 12:22:10.788503 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 559/1143] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:10 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:11.812104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:11.812709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:11.819192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:11.819676 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:11.820139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:11.820831 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:11.821287 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:11.821716 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:12.215414 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:12.223469 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b73edd81-f4b0-48a0-a249-9dfc0a7169d2 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.415765 Sep 09 12:22:12.224043 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 585/1144] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:11 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:13.246895 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:13.247531 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:13.254363 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:13.254839 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:13.255309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:13.255991 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:13.256432 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:13.256850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:13.388547 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:13.396731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-70239223-5e5a-465c-9f8e-3a1e37f0dc4c tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.154078 Sep 09 12:22:13.397292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 560/1145] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:13 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:14.421963 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:14.422790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:14.430181 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:14.430668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:14.431139 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:14.431842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:14.432298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:14.432722 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:14.575358 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:14.583863 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a3cf9575-2769-4b88-8819-2bc5a2718256 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.167504 Sep 09 12:22:14.584439 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 586/1146] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:14 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:15.608260 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:15.608883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:15.615499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:15.615985 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:15.616424 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:15.617126 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:15.617588 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:15.618020 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:15.749463 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:15.758356 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-891876c2-36c6-485b-8643-d2357c9a7c7d tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1507 microversion: 2.1 time: 0.154523 Sep 09 12:22:15.758937 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 561/1147] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:15 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:15.781073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:22:15.781659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:15.788331 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:15.788821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:15.789256 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:15.789955 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:15.790444 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:15.790870 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:15.833416 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120720) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 09 12:22:15.905660 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c0ee2d70-cc86-49c1-b6aa-62c57baed42b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "POST /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25/action" status: 202 len: 0 microversion: 2.1 time: 0.128426 Sep 09 12:22:15.906235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 587/1148] 10.222.0.62 () {60 vars in 1278 bytes} [Fri Sep 9 12:22:15 2022] POST /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:22:15.914571 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:15.915186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:15.921762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:15.922282 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:15.922722 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:15.923425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:15.923884 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:15.924318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:16.100734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:16.109265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2dc796e3-8795-4f52-ab28-dff48836212f tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1515 microversion: 2.1 time: 0.198600 Sep 09 12:22:16.109835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 562/1149] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:15 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:17.133747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:17.134490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:17.142456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:17.142971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:17.143457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:17.144383 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:17.144932 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:17.145319 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:17.287936 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:17.296487 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dab5ce5b-9fa9-4ccc-9f7b-6dcb4e0a81a0 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1517 microversion: 2.1 time: 0.167468 Sep 09 12:22:17.297071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 588/1150] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:17 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:17.364099 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-3452aad6-5687-4e0d-8e84-2b42ac7d7ca5 req-41856231-e69e-4200-8c51-b49c96e50b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2db2b0-281b-4146-bec3-2f5dd0c00f25", "name": "network-vif-unplugged", "status": "completed", "tag": "6f011037-d5e0-415c-a540-c8e479778a5f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:22:17.374970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3452aad6-5687-4e0d-8e84-2b42ac7d7ca5 req-41856231-e69e-4200-8c51-b49c96e50b26 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:17.375272 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3452aad6-5687-4e0d-8e84-2b42ac7d7ca5 req-41856231-e69e-4200-8c51-b49c96e50b26 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:17.375941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-3452aad6-5687-4e0d-8e84-2b42ac7d7ca5 req-41856231-e69e-4200-8c51-b49c96e50b26 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:17.389740 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-3452aad6-5687-4e0d-8e84-2b42ac7d7ca5 req-41856231-e69e-4200-8c51-b49c96e50b26 service nova] Creating event network-vif-unplugged:6f011037-d5e0-415c-a540-c8e479778a5f for instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 on hv-cinder-85221 Sep 09 12:22:17.394716 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-3452aad6-5687-4e0d-8e84-2b42ac7d7ca5 req-41856231-e69e-4200-8c51-b49c96e50b26 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034221 Sep 09 12:22:17.395432 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 563/1151] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:22:18.320916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:18.321481 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:18.328591 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:18.329075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:18.329518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:18.330248 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:18.330707 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:18.331131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:18.459089 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:18.467453 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-53d4736e-9b2b-4baa-a40d-9803c969a300 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.150001 Sep 09 12:22:18.468028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 589/1152] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:18 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:19.492464 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:19.493171 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:19.500412 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:19.500893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:19.501331 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:19.502051 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:19.502532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:19.502961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:19.636320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:19.644081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-86fc0b2a-cd98-469b-9d1a-da15aa91f689 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.156324 Sep 09 12:22:19.644648 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 564/1153] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:19 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:20.667718 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:20.668317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:20.674805 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:20.675282 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:20.675713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:20.676392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:20.676842 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:20.677261 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:20.809660 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:20.817492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-ee715a18-641b-4abe-958e-5df7e3993619 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.153663 Sep 09 12:22:20.818070 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 590/1154] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:20 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:21.840906 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:21.841550 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:21.848408 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:21.849110 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:21.849553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:21.850329 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:21.850788 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:21.851206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:21.984477 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:21.993840 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-77bab333-8f89-4a44-8d23-26398f1de0e3 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.156826 Sep 09 12:22:21.994446 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 565/1155] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:21 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:23.017440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:23.018050 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:23.024604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:23.025085 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:23.025516 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:23.026260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:23.026715 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:23.027142 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:23.160743 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:23.168554 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f21279b3-478d-4565-8268-9e9620b59933 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.155357 Sep 09 12:22:23.169123 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 591/1156] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:23 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:24.192683 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:24.193298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:24.199923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:24.200397 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:24.200829 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:24.201526 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:24.201973 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:24.202980 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:24.334164 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:24.341823 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6c4af25e-277a-4687-8e46-02e66037aaf6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.153218 Sep 09 12:22:24.342449 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 566/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:24 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:25.364926 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:25.365540 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:25.371520 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:25.372010 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:25.372441 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:25.373130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:25.373581 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:25.374002 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:25.507046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:25.517670 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b25d7e58-0adf-4819-873e-ef0e1a5a0011 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.156718 Sep 09 12:22:25.518260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 592/1158] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:25 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:26.541423 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:26.542028 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:26.549073 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:26.549563 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:26.550006 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:26.550844 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:26.551341 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:26.551774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:26.685975 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:26.693910 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a359e8a-8d24-40dc-94a2-3762c33cc428 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.156487 Sep 09 12:22:26.694517 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 567/1159] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:26 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:27.438018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-4cd0b82a-19c4-4222-8b1d-c7f47df3b825 req-ca312a3f-0640-402d-b5d3-776c00dd95d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2db2b0-281b-4146-bec3-2f5dd0c00f25", "name": "network-vif-plugged", "status": "completed", "tag": "6f011037-d5e0-415c-a540-c8e479778a5f"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:22:27.448593 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4cd0b82a-19c4-4222-8b1d-c7f47df3b825 req-ca312a3f-0640-402d-b5d3-776c00dd95d9 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:27.449067 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4cd0b82a-19c4-4222-8b1d-c7f47df3b825 req-ca312a3f-0640-402d-b5d3-776c00dd95d9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:27.449491 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-4cd0b82a-19c4-4222-8b1d-c7f47df3b825 req-ca312a3f-0640-402d-b5d3-776c00dd95d9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:27.463709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-4cd0b82a-19c4-4222-8b1d-c7f47df3b825 req-ca312a3f-0640-402d-b5d3-776c00dd95d9 service nova] Creating event network-vif-plugged:6f011037-d5e0-415c-a540-c8e479778a5f for instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 on hv-cinder-85221 Sep 09 12:22:27.469310 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-4cd0b82a-19c4-4222-8b1d-c7f47df3b825 req-ca312a3f-0640-402d-b5d3-776c00dd95d9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035958 Sep 09 12:22:27.469916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 593/1160] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:22:27.719526 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:27.720584 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:27.729864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:27.730580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:27.731115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:27.731977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:27.732670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:27.733956 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:27.917585 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:27.926025 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-34fef625-1596-46bc-bb72-66238a433299 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.212319 Sep 09 12:22:27.926628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 568/1161] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:27 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:28.949873 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:28.950601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:28.957909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:28.958422 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:28.958860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:28.959546 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:28.960000 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:28.960425 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:29.093240 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:29.100995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ef47c1a-a465-4a17-9836-291d7adf8a62 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1573 microversion: 2.1 time: 0.155360 Sep 09 12:22:29.101571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 594/1162] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:28 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:22:30.125217 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:22:30.125823 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:22:30.133295 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:30.133773 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:30.134265 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:30.134987 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:22:30.135439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:22:30.135886 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:22:30.270616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:22:30.278385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9c8401f6-9040-48e0-867e-338c680e7bca tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1560 microversion: 2.1 time: 0.157789 Sep 09 12:22:30.278984 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 569/1163] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:22:30 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:58.202078 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=30 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:58.203081 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:58.203484 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:58.205381 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:23:58.206972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:23:58.207130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Fri Sep 9 12:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 (ip 10.222.0.62) !!! Sep 09 12:23:58.211769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:58.212588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:58.221502 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:58.222071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:58.222622 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:58.227084 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:58.227084 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:58.227084 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:58.255898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:23:58.285847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e9435304-032b-48cb-a404-f751e072d4f8 req-d89456b2-5c84-4c6a-9644-60f8719336aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2db2b0-281b-4146-bec3-2f5dd0c00f25", "tag": "6f011037-d5e0-415c-a540-c8e479778a5f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:23:58.297452 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e9435304-032b-48cb-a404-f751e072d4f8 req-d89456b2-5c84-4c6a-9644-60f8719336aa service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:58.298212 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e9435304-032b-48cb-a404-f751e072d4f8 req-d89456b2-5c84-4c6a-9644-60f8719336aa service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:58.298656 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e9435304-032b-48cb-a404-f751e072d4f8 req-d89456b2-5c84-4c6a-9644-60f8719336aa service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:58.311999 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e9435304-032b-48cb-a404-f751e072d4f8 req-d89456b2-5c84-4c6a-9644-60f8719336aa service nova] Creating event network-changed:6f011037-d5e0-415c-a540-c8e479778a5f for instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 on hv-cinder-85221 Sep 09 12:23:58.319016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e9435304-032b-48cb-a404-f751e072d4f8 req-d89456b2-5c84-4c6a-9644-60f8719336aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118386 Sep 09 12:23:58.323053 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 570/1164] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:23:58.348647 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e85ade3f-be4c-4f91-b5d2-8bd8da7a01c6 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "DELETE /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 204 len: 0 microversion: 2.1 time: 0.150422 Sep 09 12:23:58.349217 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 595/1165] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:23:58 2022] DELETE /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:23:58.359579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:58.360339 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:58.366670 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:58.367164 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:58.367604 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:58.368324 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:58.368859 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:58.369292 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:58.529165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:58.537021 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-af34d4e8-709d-44a2-95b5-ec50291a3d6b tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.183321 Sep 09 12:23:58.537603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 571/1166] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:58 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:23:59.561495 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:23:59.562302 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:23:59.569694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:59.570263 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:59.570694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:59.571382 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:23:59.571827 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:23:59.572243 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:23:59.709568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:23:59.717405 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b37434fb-dcd9-4f08-ab6c-2f12da9f40a5 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1566 microversion: 2.1 time: 0.160192 Sep 09 12:23:59.717974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 596/1167] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:23:59 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:00.712661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e2138975-379c-4032-a355-1e093b64ed42 req-aa3f565d-501e-48d3-bd2f-3a63c1617a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2db2b0-281b-4146-bec3-2f5dd0c00f25", "name": "network-vif-deleted", "tag": "6f011037-d5e0-415c-a540-c8e479778a5f"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:00.723155 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e2138975-379c-4032-a355-1e093b64ed42 req-aa3f565d-501e-48d3-bd2f-3a63c1617a87 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:00.723634 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e2138975-379c-4032-a355-1e093b64ed42 req-aa3f565d-501e-48d3-bd2f-3a63c1617a87 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:00.724056 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e2138975-379c-4032-a355-1e093b64ed42 req-aa3f565d-501e-48d3-bd2f-3a63c1617a87 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:00.735240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e2138975-379c-4032-a355-1e093b64ed42 req-aa3f565d-501e-48d3-bd2f-3a63c1617a87 service nova] Creating event network-vif-deleted:6f011037-d5e0-415c-a540-c8e479778a5f for instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 on hv-cinder-85221 Sep 09 12:24:00.740455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e2138975-379c-4032-a355-1e093b64ed42 req-aa3f565d-501e-48d3-bd2f-3a63c1617a87 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031455 Sep 09 12:24:00.741244 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 572/1168] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:00.743414 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:00.744378 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:00.751844 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:00.752330 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:00.752766 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:00.753467 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:00.753920 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:00.754478 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:00.832720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e4d42a3879f4ec2b422f4bc8dd2dea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d88da533a4432a97eb9644ce21fcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:00.841506 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95cac77c-6c55-4947-8c16-845fc14faf43 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 200 len: 1219 microversion: 2.1 time: 0.104094 Sep 09 12:24:00.842109 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 597/1169] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:00 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:01.866141 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:01.866766 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] [instance: 0c2db2b0-281b-4146-bec3-2f5dd0c00f25] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:01.872849 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:01.873334 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:01.873767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:01.874485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:01.874941 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:01.875497 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:01.889462 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] HTTP exception thrown: Instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 could not be found. Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Request method failure captured: Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 HTTP/1.1 Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGy8EPsW6gGW_8xOdVj8M6pOtj2W_aRF0nM3AiOeFIUhQUeP2bzZjDwesSzn2LwH9818izWwXnTsH7jp1t6SEtm-H3uf2Rsh4RMxkiGTBjwzXcnawibiJVurujcUNQxdNVQvJjMHiNCfP3vqkMXHLCSk3AdsfsBJ0pcdg6N0IYKUvxf4 Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 26d88da533a4432a97eb9644ce21fcfe Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestShelveInstance-923496304 Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:24:01.891230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/26d88da533a4432a97eb9644ce21fcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_26d88da533a4432a97eb9644ce21fcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/26d88da533a4432a97eb9644ce21fcfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/26d88da533a4432a97eb9644ce21fcfe"}]}] Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestShelveInstance-923496304 Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 26d88da533a4432a97eb9644ce21fcfe Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestShelveInstance-923496304 Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-TestShelveInstance-923496304-project Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: 7e4d42a3879f4ec2b422f4bc8dd2dea9 Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestShelveInstance-923496304-project Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 could not be found. Sep 09 12:24:01.893071 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': '0c2db2b0-281b-4146-bec3-2f5dd0c00f25'} Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 could not be found. Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:24:01.894372 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 could not be found. Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 could not be found. Sep 09 12:24:01.896132 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:24:01.897732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Returning 404 to user: Instance 0c2db2b0-281b-4146-bec3-2f5dd0c00f25 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:24:01.897732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f4574858-2301-4953-a7b1-d982586e2d08 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25" status: 404 len: 111 microversion: 2.1 time: 0.031314 Sep 09 12:24:01.897732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 573/1170] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:01 2022] GET /compute/v2.1/servers/0c2db2b0-281b-4146-bec3-2f5dd0c00f25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:24:02.049572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-3e805cff-5b79-45a4-b457-8fefa4b5a2a1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] Calling method '.version_select at 0x7ff2d96dbe50>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:02.074504 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-3e805cff-5b79-45a4-b457-8fefa4b5a2a1 tempest-TestShelveInstance-923496304 tempest-TestShelveInstance-923496304-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-694532186" status: 202 len: 0 microversion: 2.1 time: 0.028497 Sep 09 12:24:02.075318 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 598/1171] 10.222.0.62 () {58 vars in 1251 bytes} [Fri Sep 9 12:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-694532186 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 09 12:24:19.043730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:19.044860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=12 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:19.271579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-069bfa89-e040-4ab3-8674-dd1bc4383953 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Action: 'create', calling method: .version_select at 0x7ff2d92971f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1111752406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTr6YQSG9Ykh0VYZNBlyA5fkIwKt7lqkfgwDx6dm8jW82q7vVviuonRFUK3XjpUFb+UA2lH9OpLngK5J/zP4u3xo2mAxBCXJYyDETtj7WHKdh5N6G4Ww+zv/OpLea1q0A=="}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:19.289090 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-069bfa89-e040-4ab3-8674-dd1bc4383953 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for project 2b477593590943b88325822f014f0411. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:24:19.293215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-069bfa89-e040-4ab3-8674-dd1bc4383953 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for user e7f34fed804446a98762e11bce9d7b3c and project 2b477593590943b88325822f014f0411. Resources: {'key_pairs'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:24:19.321836 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-069bfa89-e040-4ab3-8674-dd1bc4383953 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.282972 Sep 09 12:24:19.322661 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 574/1172] 10.222.0.62 () {60 vars in 1159 bytes} [Fri Sep 9 12:24:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:24:39.893403 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:39.894242 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:39.898222 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-323300738", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1111752406", "security_groups": [{"name": "tempest-secgroup-smoke-1085153086"}], "block_device_mapping_v2": [{"uuid": "8e7a2a36-5f9b-4dcf-a0d5-e18c77d56aef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5112834c-6524-4515-93b9-06d9494c7949"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:40.021518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] validate_networks() for [('5112834c-6524-4515-93b9-06d9494c7949', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:24:40.495978 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:24:40.496397 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:24:40.496860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:24:40.497262 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:24:40.497666 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:24:40.507167 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:40.507638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:40.508066 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:40.508780 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:40.509228 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:40.509644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:40.526364 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for project 2b477593590943b88325822f014f0411. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:24:40.530256 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for user e7f34fed804446a98762e11bce9d7b3c and project 2b477593590943b88325822f014f0411. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:24:40.588227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:24:40.590426 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e7a2a36-5f9b-4dcf-a0d5-e18c77d56aef',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:24:40.718074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-2247303a-9df1-46f2-b0cd-2cdbe4c4e62b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.826087 Sep 09 12:24:40.718758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 599/1173] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:24:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:24:40.729915 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-68d297f3-2ef8-4c05-8f53-ad81051d6c1d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:40.730574 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-68d297f3-2ef8-4c05-8f53-ad81051d6c1d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:40.732667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:40.734526 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:40.794207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-68d297f3-2ef8-4c05-8f53-ad81051d6c1d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:40.801628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-68d297f3-2ef8-4c05-8f53-ad81051d6c1d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1094 microversion: 2.1 time: 0.075656 Sep 09 12:24:40.802219 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 575/1174] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:40 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:41.825037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dc291bc0-31e4-4fe7-9416-bde9282a299e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:41.825687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dc291bc0-31e4-4fe7-9416-bde9282a299e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:41.889437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dc291bc0-31e4-4fe7-9416-bde9282a299e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:41.898329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dc291bc0-31e4-4fe7-9416-bde9282a299e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1094 microversion: 2.1 time: 0.077539 Sep 09 12:24:41.899154 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 600/1175] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:41 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:42.923226 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d281e9f4-ecd4-4495-a5c3-54103c74fd67 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:42.923787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d281e9f4-ecd4-4495-a5c3-54103c74fd67 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:42.985872 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d281e9f4-ecd4-4495-a5c3-54103c74fd67 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:42.992729 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d281e9f4-ecd4-4495-a5c3-54103c74fd67 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1094 microversion: 2.1 time: 0.074132 Sep 09 12:24:42.993293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 576/1176] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:42 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:44.017384 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:44.017977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:44.024398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:44.024890 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:44.025329 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:44.026025 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:44.026510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:44.026990 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:44.088968 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:44.096699 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-42358eee-3661-450a-8301-211c2c6c5b82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1144 microversion: 2.1 time: 0.083919 Sep 09 12:24:44.097264 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 601/1177] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:44 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:45.120059 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:45.120710 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:45.128698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:45.129235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:45.129721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:45.130987 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:45.131455 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:45.131889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:45.223096 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:45.232980 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d590e162-ce3e-4eaf-9f60-a408b8a66f43 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1200 microversion: 2.1 time: 0.116893 Sep 09 12:24:45.237885 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 577/1178] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:45 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:46.257170 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:46.257701 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:46.264219 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:46.265230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:46.265663 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:46.266392 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:46.266853 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:46.267280 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:46.412437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:46.420386 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-df4a899b-b8a6-4078-ba5d-b40ded515fab tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.167178 Sep 09 12:24:46.421724 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 602/1179] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:46 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:46.883913 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-a70d23e2-e058-4906-bdee-45d60584eb2e req-0ef845e0-bf14-4183-a9e5-b71a5c074e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65a4779-7015-410f-99b0-668016bf8cdc", "tag": "3b9c4093-2b17-4af3-9cd5-9d47064f19b3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:46.894493 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a70d23e2-e058-4906-bdee-45d60584eb2e req-0ef845e0-bf14-4183-a9e5-b71a5c074e9b service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:46.895029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a70d23e2-e058-4906-bdee-45d60584eb2e req-0ef845e0-bf14-4183-a9e5-b71a5c074e9b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:46.895535 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-a70d23e2-e058-4906-bdee-45d60584eb2e req-0ef845e0-bf14-4183-a9e5-b71a5c074e9b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:46.908066 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-a70d23e2-e058-4906-bdee-45d60584eb2e req-0ef845e0-bf14-4183-a9e5-b71a5c074e9b service nova] Creating event network-changed:3b9c4093-2b17-4af3-9cd5-9d47064f19b3 for instance e65a4779-7015-410f-99b0-668016bf8cdc on hv-cinder-85221 Sep 09 12:24:46.913516 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-a70d23e2-e058-4906-bdee-45d60584eb2e req-0ef845e0-bf14-4183-a9e5-b71a5c074e9b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091975 Sep 09 12:24:46.914144 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 578/1180] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:24:47.444590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:47.445206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:47.451700 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:47.452184 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:47.452623 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:47.453316 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:47.453774 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:47.454235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:47.587525 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:47.595171 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c59d9a1a-fa25-4f53-a271-115f3e63a111 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.154578 Sep 09 12:24:47.595730 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 603/1181] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:47 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:48.621090 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:48.621835 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:48.630667 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:48.631157 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:48.631597 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:48.634418 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:48.634899 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:48.635489 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:48.768579 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:48.777077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8428a6c2-eecd-425d-adb1-14db0cc38f3f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.162295 Sep 09 12:24:48.777645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 579/1182] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:48 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:49.800279 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:49.800900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:49.807301 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:49.807783 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:49.808225 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:49.808905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:49.809359 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:49.809777 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:49.938340 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:49.946346 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-5961a222-e76a-4eae-80a6-4aec21f85a8f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.149928 Sep 09 12:24:49.948534 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 604/1183] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:49 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:50.973157 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:50.973779 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:50.980264 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:50.980738 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:50.981172 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:50.981850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:50.982338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:50.982760 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:51.113354 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:51.120876 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2e5ad564-676e-4f21-bccd-3c79e68a0abd tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.152087 Sep 09 12:24:51.121434 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 580/1184] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:50 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:52.145023 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:52.145588 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:52.147418 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:52.148557 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=8 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:52.154065 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:52.154572 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:52.155007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:52.155697 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:52.156155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:52.156913 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:52.292646 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:52.300373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-dfc6c17c-30a6-4574-9586-1a94cf68d873 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.159919 Sep 09 12:24:52.300939 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 605/1185] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:52 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:53.323268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:53.323834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:53.326213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=4 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:24:53.332180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:53.332671 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:53.333111 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:53.333810 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:53.334310 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:53.334742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:53.465479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:53.473197 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-93e7e6dc-b03a-4068-8840-d5ba9ad98a74 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.153929 Sep 09 12:24:53.473893 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 581/1186] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:53 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:54.495954 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:54.496499 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:54.503512 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:54.503993 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:54.504455 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:54.505155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:54.505613 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:54.506039 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:54.638206 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:54.646600 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-56d3bcc4-7ebc-4297-ad9c-bbad5a313db4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.154673 Sep 09 12:24:54.647173 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 606/1187] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:54 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:55.668499 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:55.669107 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:55.676124 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:55.676603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:55.677039 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:55.677721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:55.678206 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:55.678630 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:55.809603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:55.817918 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7fda39da-155c-4e84-b38e-be9553b7cad7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.153287 Sep 09 12:24:55.818532 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 582/1188] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:55 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:56.840668 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:56.841267 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:56.848790 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:56.849271 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:56.849710 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:56.850492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:56.850945 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:56.851366 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:56.981182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:56.989568 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-921c35d6-bcda-4491-9ccd-98954788c70d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.152819 Sep 09 12:24:56.990158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 607/1189] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:56 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:58.013828 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:58.014504 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:58.020926 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:58.021406 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:58.021838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:58.022562 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:58.023013 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:58.023437 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:58.169087 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:58.178762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-41fb34cf-34c3-4acf-8fc3-02ef7dad8632 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.169386 Sep 09 12:24:58.179545 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 583/1190] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:58 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:24:58.223563 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-265752f6-8d37-485b-bf03-13f47c364040 req-969f870b-0cef-4d9c-801e-3a0dc9af60c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65a4779-7015-410f-99b0-668016bf8cdc", "name": "network-vif-plugged", "status": "completed", "tag": "3b9c4093-2b17-4af3-9cd5-9d47064f19b3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:24:58.233869 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-265752f6-8d37-485b-bf03-13f47c364040 req-969f870b-0cef-4d9c-801e-3a0dc9af60c7 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:58.234383 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-265752f6-8d37-485b-bf03-13f47c364040 req-969f870b-0cef-4d9c-801e-3a0dc9af60c7 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:58.234818 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-265752f6-8d37-485b-bf03-13f47c364040 req-969f870b-0cef-4d9c-801e-3a0dc9af60c7 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:58.250830 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-265752f6-8d37-485b-bf03-13f47c364040 req-969f870b-0cef-4d9c-801e-3a0dc9af60c7 service nova] Creating event network-vif-plugged:3b9c4093-2b17-4af3-9cd5-9d47064f19b3 for instance e65a4779-7015-410f-99b0-668016bf8cdc on hv-cinder-85221 Sep 09 12:24:58.253188 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-265752f6-8d37-485b-bf03-13f47c364040 req-969f870b-0cef-4d9c-801e-3a0dc9af60c7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100726 Sep 09 12:24:58.253886 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 608/1191] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:24:59.208179 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:24:59.208774 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:24:59.215234 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:59.215721 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:59.216165 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:59.216861 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:24:59.217320 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:24:59.217749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:24:59.357726 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:24:59.366010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-793ead97-b70f-4013-b036-b9e62a3c3767 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1266 microversion: 2.1 time: 0.162573 Sep 09 12:24:59.366607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 584/1192] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:24:59 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:00.389566 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:00.390503 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:00.397239 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:00.397726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:00.398180 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:00.398871 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:00.399325 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:00.399749 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:00.539828 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:00.547720 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b6661cc9-97ec-445c-8b40-69bf72a9bfff tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1454 microversion: 2.1 time: 0.162340 Sep 09 12:25:00.548307 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 609/1193] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:00 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:00.569968 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:25:00.570613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:25:00.577049 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:00.577540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:00.577981 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:00.578698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:00.579153 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:00.580249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:00.711700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:25:00.719618 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f99c7a28-60df-4458-b0e6-c51a8b835cf4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1454 microversion: 2.1 time: 0.153447 Sep 09 12:25:00.720259 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 585/1194] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:25:00 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:25:02.389591 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-c60dfdc0-ae5c-4f96-8f29-ec2c94da8ab4 req-7a6ea313-7acd-4ffa-9a1b-3609e423356a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65a4779-7015-410f-99b0-668016bf8cdc", "tag": "3b9c4093-2b17-4af3-9cd5-9d47064f19b3"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:25:02.400482 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c60dfdc0-ae5c-4f96-8f29-ec2c94da8ab4 req-7a6ea313-7acd-4ffa-9a1b-3609e423356a service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:25:02.400972 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c60dfdc0-ae5c-4f96-8f29-ec2c94da8ab4 req-7a6ea313-7acd-4ffa-9a1b-3609e423356a service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:25:02.401402 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-c60dfdc0-ae5c-4f96-8f29-ec2c94da8ab4 req-7a6ea313-7acd-4ffa-9a1b-3609e423356a service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:25:02.413324 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-c60dfdc0-ae5c-4f96-8f29-ec2c94da8ab4 req-7a6ea313-7acd-4ffa-9a1b-3609e423356a service nova] Creating event network-changed:3b9c4093-2b17-4af3-9cd5-9d47064f19b3 for instance e65a4779-7015-410f-99b0-668016bf8cdc on hv-cinder-85221 Sep 09 12:25:02.418607 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-c60dfdc0-ae5c-4f96-8f29-ec2c94da8ab4 req-7a6ea313-7acd-4ffa-9a1b-3609e423356a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032562 Sep 09 12:25:02.419236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 610/1195] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:27:16.333213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f97fee8-8836-42ad-915f-2eefb6cc472d] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 09 12:27:16.334016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=26 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:16.334746 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=50 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:16.336022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 12:27:16.336168 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc (ip 10.222.0.62) !!! Sep 09 12:27:16.337186 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:27:16.337327 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc (ip 10.222.0.62) !!! Sep 09 12:27:16.342361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:16.342856 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:16.351857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:16.352365 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:16.352796 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:16.353494 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:16.353939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:16.354386 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:16.380964 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Going to try to terminate instance {{(pid=120719) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:27:16.453364 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-168a5729-c740-4ced-8e34-516c8785047f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 204 len: 0 microversion: 2.1 time: 0.121603 Sep 09 12:27:16.453983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 586/1196] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:27:16 2022] DELETE /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:27:16.464498 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:16.465370 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:16.467957 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:16.468747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=54 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:16.470136 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 12:27:16.470309 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Fri Sep 9 12:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc (ip 10.222.0.62) !!! Sep 09 12:27:16.471900 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 09 12:27:16.472028 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Fri Sep 9 12:27:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc (ip 10.222.0.62) !!! Sep 09 12:27:16.481477 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:16.481981 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:16.482448 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:16.483156 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:16.483615 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:16.484047 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:16.705786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:16.713606 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a7672816-8d74-40a2-afd3-3f07fe8942da tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1579 microversion: 2.1 time: 0.254756 Sep 09 12:27:16.714190 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 611/1197] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:16 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1579 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:17.737263 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:17.737961 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:17.749252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:17.749751 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:17.750249 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:17.750971 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:17.752211 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:17.752663 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:17.760040 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f97fee8-8836-42ad-915f-2eefb6cc472d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38548. Sep 09 12:27:17.940245 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:17.948010 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-dddf518a-99f0-4088-8cc2-dbe67acc3b63 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1579 microversion: 2.1 time: 0.215038 Sep 09 12:27:17.948580 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 587/1198] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:17 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1579 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:18.972277 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:18.972894 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:18.979516 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:18.980013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:18.980454 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:18.981158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:18.981617 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:18.982044 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:19.048152 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:19.055912 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0f9d2378-ab6a-48ee-97ae-deb2661c602a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1511 microversion: 2.1 time: 0.088224 Sep 09 12:27:19.056497 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 612/1199] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:18 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:19.165340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-80540a44-d992-46ec-bb83-b955f1aea996 req-744b24b5-701c-4d2f-aa75-cf0cef85d9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65a4779-7015-410f-99b0-668016bf8cdc", "name": "network-vif-deleted", "tag": "3b9c4093-2b17-4af3-9cd5-9d47064f19b3"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:19.179912 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-80540a44-d992-46ec-bb83-b955f1aea996 req-744b24b5-701c-4d2f-aa75-cf0cef85d9af service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:19.180470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-80540a44-d992-46ec-bb83-b955f1aea996 req-744b24b5-701c-4d2f-aa75-cf0cef85d9af service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:19.180972 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-80540a44-d992-46ec-bb83-b955f1aea996 req-744b24b5-701c-4d2f-aa75-cf0cef85d9af service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:19.202577 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-80540a44-d992-46ec-bb83-b955f1aea996 req-744b24b5-701c-4d2f-aa75-cf0cef85d9af service nova] Creating event network-vif-deleted:3b9c4093-2b17-4af3-9cd5-9d47064f19b3 for instance e65a4779-7015-410f-99b0-668016bf8cdc on hv-cinder-85221 Sep 09 12:27:19.211801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-80540a44-d992-46ec-bb83-b955f1aea996 req-744b24b5-701c-4d2f-aa75-cf0cef85d9af service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050270 Sep 09 12:27:19.212644 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 588/1200] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:27:20.079797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:20.080589 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:20.088831 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:20.089456 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:20.089988 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:20.090843 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:20.091440 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:20.092093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:20.134338 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:20.134930 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:20.135474 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:20.136056 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.objects.instance [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lazy-loading 'fault' on Instance uuid e65a4779-7015-410f-99b0-668016bf8cdc {{(pid=120720) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 09 12:27:20.181350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:20.188349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-7593d6b7-a694-4f97-80e1-7d0a2ac24e6a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 200 len: 1184 microversion: 2.1 time: 0.112710 Sep 09 12:27:20.189093 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 613/1201] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:20 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 1184 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 09 12:27:21.211761 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:21.212458 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:21.219700 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:21.220102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:21.220539 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:21.221235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:21.221689 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:21.222129 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:21.236364 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] HTTP exception thrown: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Request method failure captured: Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc HTTP/1.1 Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGzBtelaDXDWt4uLuVKzp7m-CUj86z9yAThoBjOAbzuHxA5vbzY75fhhXUQeISSVPc3nXsRCQ6AdUdLS1mq18zpPBSa2APiuiw6oOlbog635oQMVVDHq6PhYIC0HuHLqacvJGhcC0ZYykSEc_pYUAN0icflcZxFvpqc_fIOjHdUoeZH4 Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 2b477593590943b88325822f014f0411 Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:27:21.238002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b477593590943b88325822f014f0411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b477593590943b88325822f014f0411"}]}] Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-900860800 Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2b477593590943b88325822f014f0411 Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: e7f34fed804446a98762e11bce9d7b3c Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:27:21.239645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'e65a4779-7015-410f-99b0-668016bf8cdc'} Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:27:21.240697 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:27:21.242628 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:27:21.244242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Returning 404 to user: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:27:21.244242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-f5d4fbd0-44ec-4526-87dd-2de670f7473c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 404 len: 111 microversion: 2.1 time: 0.031928 Sep 09 12:27:21.244242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 589/1202] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:21 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 09 12:27:21.287204 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1862841741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1111752406", "security_groups": [{"name": "tempest-secgroup-smoke-1085153086"}], "block_device_mapping_v2": [{"uuid": "8e7a2a36-5f9b-4dcf-a0d5-e18c77d56aef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5112834c-6524-4515-93b9-06d9494c7949"}]}} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:21.400350 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.network.neutron [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] validate_networks() for [('5112834c-6524-4515-93b9-06d9494c7949', None, None, None, None, None)] {{(pid=120720) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:27:21.764659 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Flavor limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:27:21.765111 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Image limits 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:27:21.765585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Flavor pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:27:21.765993 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Image pref 0:0:0 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:27:21.766444 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.virt.hardware [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120720) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:27:21.775698 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:21.776182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:21.776618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:21.777365 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:21.777902 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:21.778365 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:21.795443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for project 2b477593590943b88325822f014f0411. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:27:21.799424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.quota [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for user e7f34fed804446a98762e11bce9d7b3c and project 2b477593590943b88325822f014f0411. Resources: {'ram', 'cores', 'instances'} {{(pid=120720) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:27:21.855451 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Going to run 1 instances... {{(pid=120720) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:27:21.857608 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e7a2a36-5f9b-4dcf-a0d5-e18c77d56aef',volume_size=None,volume_type=None)] {{(pid=120720) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:27:21.989687 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-c3614762-33e4-40a4-adf6-cee593e205d4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706259 Sep 09 12:27:21.990545 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 614/1203] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:27:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 09 12:27:22.001461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-bf1972f9-dc28-462d-a3b0-f0b8732b81c1 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:22.002370 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-bf1972f9-dc28-462d-a3b0-f0b8732b81c1 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:22.064332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-bf1972f9-dc28-462d-a3b0-f0b8732b81c1 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:22.071215 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-bf1972f9-dc28-462d-a3b0-f0b8732b81c1 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1095 microversion: 2.1 time: 0.073636 Sep 09 12:27:22.072262 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 590/1204] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:21 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:23.096235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:23.097088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:23.109839 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:23.110434 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:23.111382 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:23.112117 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:23.112570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:23.113165 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:23.179061 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:23.186746 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-f7275e7a-8b9f-4ba7-8e2b-74c5e3b3c834 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1211 microversion: 2.1 time: 0.096726 Sep 09 12:27:23.187308 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 615/1205] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:23 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1211 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:24.208857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:24.209422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:24.219279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:24.220210 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:24.220646 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:24.221343 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:24.221797 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:24.222250 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:24.426762 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:24.434534 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8dbe2e74-abfa-44f3-ad67-12cedaefba7d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.229496 Sep 09 12:27:24.435118 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 591/1206] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:24 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:24.679773 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-af9fbc62-7399-4d24-aba2-8ef4f76a7803 req-c8cc7468-d9a4-4543-ae29-40ec5247f0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b48dc1bb-7b72-47a7-a0c0-5ed2f6176474", "tag": "18bd7910-811c-4714-82b3-59a2c55b4936"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:24.685881 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9fe693e6-4de5-4d31-9ac3-36f06b1d7be9] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 09 12:27:24.692691 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-af9fbc62-7399-4d24-aba2-8ef4f76a7803 req-c8cc7468-d9a4-4543-ae29-40ec5247f0a1 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:24.693173 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-af9fbc62-7399-4d24-aba2-8ef4f76a7803 req-c8cc7468-d9a4-4543-ae29-40ec5247f0a1 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:24.693603 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-af9fbc62-7399-4d24-aba2-8ef4f76a7803 req-c8cc7468-d9a4-4543-ae29-40ec5247f0a1 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:24.704913 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-af9fbc62-7399-4d24-aba2-8ef4f76a7803 req-c8cc7468-d9a4-4543-ae29-40ec5247f0a1 service nova] Creating event network-changed:18bd7910-811c-4714-82b3-59a2c55b4936 for instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 on hv-cinder-85221 Sep 09 12:27:24.710155 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-af9fbc62-7399-4d24-aba2-8ef4f76a7803 req-c8cc7468-d9a4-4543-ae29-40ec5247f0a1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036236 Sep 09 12:27:24.710833 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 616/1207] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:27:25.459248 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:25.459846 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:25.466242 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:25.466727 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:25.467166 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:25.467869 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:25.468323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:25.468749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:25.599749 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:25.608376 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-9f61841b-362e-4073-8bc9-cfaac78064fe tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.152956 Sep 09 12:27:25.609068 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 592/1208] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:25 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:26.633215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:26.633916 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:26.642829 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:26.643458 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:26.643896 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:26.644599 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:26.645056 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:26.645486 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:26.651866 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [9fe693e6-4de5-4d31-9ac3-36f06b1d7be9] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38598. Sep 09 12:27:26.785769 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:26.793570 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-0985cbd6-e1f0-447b-9aec-d12a4474368d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.164655 Sep 09 12:27:26.794157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 617/1209] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:26 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:27.816390 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:27.817016 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:27.823718 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:27.824208 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:27.824653 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:27.825359 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:27.825820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:27.826279 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:27.962838 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:27.971293 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4230b6cf-5632-43ee-b35d-3861d3cd3114 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.158738 Sep 09 12:27:27.971862 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 593/1210] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:27 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:28.992964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:28.993583 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:29.000001 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:29.000490 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:29.000940 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:29.001618 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:29.002347 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:29.002765 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:29.131544 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:29.139229 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-95ef4baf-067d-4c6e-bea1-eed54efe09eb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.150195 Sep 09 12:27:29.139794 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 618/1211] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:28 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:30.160977 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:30.161612 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:30.167970 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:30.168443 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:30.168876 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:30.169560 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:30.170006 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:30.170459 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:30.305380 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:30.313113 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-91f6f939-f8bc-4beb-bf99-eb02eb08cf25 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.156069 Sep 09 12:27:30.314344 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 594/1212] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:30 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:31.336205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:31.336821 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:31.343577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:31.344071 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:31.344510 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:31.345215 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:31.345672 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:31.346100 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:31.479075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:31.487230 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b5c2da6c-155a-46b8-9ddc-781e27625224 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.154909 Sep 09 12:27:31.487803 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 619/1213] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:31 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:32.510541 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:32.511100 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:32.513469 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:32.519509 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:32.519994 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:32.520425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:32.521147 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:32.521596 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:32.522015 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:32.654252 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:32.662009 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7f7f0d5-1300-4857-a318-7a11e88194af tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.155543 Sep 09 12:27:32.662606 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 595/1214] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:32 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:33.684421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:33.685049 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:33.687054 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=2 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:33.687872 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=6 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:27:33.694492 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:33.695005 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:33.695442 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:33.696143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:33.696597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:33.697021 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:33.838320 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:33.846598 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-074d2f4b-9848-486e-880a-f90351fc1d08 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.166043 Sep 09 12:27:33.847164 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 620/1215] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:33 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:34.868108 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:34.868745 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:34.875247 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:34.876012 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:34.876456 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:34.877411 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:34.877874 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:34.878338 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:35.018109 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:35.025949 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-4e69d68d-43dd-45da-9a88-fd5a325ab68e tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.161771 Sep 09 12:27:35.026569 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 596/1216] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:34 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:35.067312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-bbae562e-4221-43e7-9e6c-5087b8822500 req-03976995-d244-4979-8563-007f2db83c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b48dc1bb-7b72-47a7-a0c0-5ed2f6176474", "name": "network-vif-plugged", "status": "completed", "tag": "18bd7910-811c-4714-82b3-59a2c55b4936"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:35.080260 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bbae562e-4221-43e7-9e6c-5087b8822500 req-03976995-d244-4979-8563-007f2db83c0b service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:35.080748 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bbae562e-4221-43e7-9e6c-5087b8822500 req-03976995-d244-4979-8563-007f2db83c0b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:35.081178 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-bbae562e-4221-43e7-9e6c-5087b8822500 req-03976995-d244-4979-8563-007f2db83c0b service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:35.092131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-bbae562e-4221-43e7-9e6c-5087b8822500 req-03976995-d244-4979-8563-007f2db83c0b service nova] Creating event network-vif-plugged:18bd7910-811c-4714-82b3-59a2c55b4936 for instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 on hv-cinder-85221 Sep 09 12:27:35.097983 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-bbae562e-4221-43e7-9e6c-5087b8822500 req-03976995-d244-4979-8563-007f2db83c0b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034331 Sep 09 12:27:35.098604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 621/1217] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:27:36.050613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:36.051230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:36.057783 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:36.058309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:36.058753 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:36.059450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:36.059908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:36.060340 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:36.203923 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:36.211543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-6a20d946-4d85-4f00-9b16-da9460b13cf2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1267 microversion: 2.1 time: 0.165676 Sep 09 12:27:36.212102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 597/1218] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:36 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:37.234782 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:37.235424 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:37.242018 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:37.242531 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:37.242971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:37.243644 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:37.244088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:37.244505 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:37.373747 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:37.382387 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e7c9fe34-ed65-43e9-ab03-154e510ffa35 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1454 microversion: 2.1 time: 0.151831 Sep 09 12:27:37.382962 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 622/1219] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:37 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:37.404540 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:27:37.405151 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:27:37.411616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:37.412102 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:37.412543 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:37.413240 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:37.413695 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:37.414140 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:37.544062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:27:37.552422 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-12fb2957-8263-461e-8975-5d822d8f1ce3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1454 microversion: 2.1 time: 0.151733 Sep 09 12:27:37.552995 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 598/1220] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:27:37 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:27:39.388379 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8b090f06-dec9-408e-815b-2e387f0b88a8 req-c6e9bf34-59d5-4287-b7d2-8f23f309fa9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b48dc1bb-7b72-47a7-a0c0-5ed2f6176474", "tag": "18bd7910-811c-4714-82b3-59a2c55b4936"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:27:39.398317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8b090f06-dec9-408e-815b-2e387f0b88a8 req-c6e9bf34-59d5-4287-b7d2-8f23f309fa9e service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:27:39.398802 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8b090f06-dec9-408e-815b-2e387f0b88a8 req-c6e9bf34-59d5-4287-b7d2-8f23f309fa9e service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:27:39.399235 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8b090f06-dec9-408e-815b-2e387f0b88a8 req-c6e9bf34-59d5-4287-b7d2-8f23f309fa9e service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:27:39.410960 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8b090f06-dec9-408e-815b-2e387f0b88a8 req-c6e9bf34-59d5-4287-b7d2-8f23f309fa9e service nova] Creating event network-changed:18bd7910-811c-4714-82b3-59a2c55b4936 for instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 on hv-cinder-85221 Sep 09 12:27:39.415995 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8b090f06-dec9-408e-815b-2e387f0b88a8 req-c6e9bf34-59d5-4287-b7d2-8f23f309fa9e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Sep 09 12:27:39.416625 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 623/1221] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:29:39.367750 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:29:39.368501 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:29:39.373954 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-624805285", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1111752406", "security_groups": [{"name": "tempest-secgroup-smoke-1085153086"}], "block_device_mapping_v2": [{"uuid": "0f0fe037-24a0-4f8f-ba90-7a9bc66ae665", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5112834c-6524-4515-93b9-06d9494c7949"}]}} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:29:39.495321 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.network.neutron [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] validate_networks() for [('5112834c-6524-4515-93b9-06d9494c7949', None, None, None, None, None)] {{(pid=120719) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 09 12:29:39.926025 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Flavor limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 09 12:29:39.926553 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Image limits 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 09 12:29:39.927029 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Flavor pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 09 12:29:39.927440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Image pref 0:0:0 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 09 12:29:39.927850 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.virt.hardware [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120719) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 09 12:29:39.936625 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:39.937110 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:39.937542 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:39.938312 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:39.938770 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:39.939847 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:39.956257 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for project 2b477593590943b88325822f014f0411. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 09 12:29:39.960298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.quota [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Getting quotas for user e7f34fed804446a98762e11bce9d7b3c and project 2b477593590943b88325822f014f0411. Resources: {'ram', 'cores', 'instances'} {{(pid=120719) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 09 12:29:40.017747 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Going to run 1 instances... {{(pid=120719) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 09 12:29:40.019945 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f0fe037-24a0-4f8f-ba90-7a9bc66ae665',volume_size=None,volume_type=None)] {{(pid=120719) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 09 12:29:40.149296 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-0db485b1-a7af-45e3-89ab-e16c4b11ed9b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783291 Sep 09 12:29:40.149951 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 599/1222] 10.222.0.62 () {60 vars in 1147 bytes} [Fri Sep 9 12:29:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 09 12:29:40.159597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9fe693e6-4de5-4d31-9ac3-36f06b1d7be9] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 09 12:29:40.161437 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:29:40.161977 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=64 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:29:40.167904 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-edfa0708-6a0a-4e53-917c-8d28cd8ef968 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:40.168601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-edfa0708-6a0a-4e53-917c-8d28cd8ef968 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:40.227518 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-edfa0708-6a0a-4e53-917c-8d28cd8ef968 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:40.234354 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-edfa0708-6a0a-4e53-917c-8d28cd8ef968 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1094 microversion: 2.1 time: 0.077145 Sep 09 12:29:40.234913 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 624/1223] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:40 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:41.258413 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-53c8b801-cf9e-4179-8449-1cc09201d02a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:41.259036 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-53c8b801-cf9e-4179-8449-1cc09201d02a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:41.334439 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-53c8b801-cf9e-4179-8449-1cc09201d02a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:41.340662 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-53c8b801-cf9e-4179-8449-1cc09201d02a tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1094 microversion: 2.1 time: 0.086622 Sep 09 12:29:41.341493 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 600/1224] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:41 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:42.363335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a71cfc44-9b33-43cf-8aef-2269e7de5524 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:42.363952 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a71cfc44-9b33-43cf-8aef-2269e7de5524 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:42.388402 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] [9fe693e6-4de5-4d31-9ac3-36f06b1d7be9] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38736. Sep 09 12:29:42.419271 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-a71cfc44-9b33-43cf-8aef-2269e7de5524 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:42.426144 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a71cfc44-9b33-43cf-8aef-2269e7de5524 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1094 microversion: 2.1 time: 0.066646 Sep 09 12:29:42.426723 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 625/1225] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:42 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:43.448882 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:43.449497 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:43.456523 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:43.457002 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:43.457440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:43.458154 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:43.458616 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:43.459045 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:43.521698 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:43.529602 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-d4f7bb63-94cc-4582-84c8-511e23397c04 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1144 microversion: 2.1 time: 0.084637 Sep 09 12:29:43.530194 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 601/1226] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:43 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:44.555751 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:44.556396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:44.563044 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:44.563532 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:44.563971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:44.564677 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:44.565131 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:44.565561 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:44.630501 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:44.638223 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-22031ffe-8158-4b61-9ee9-0d12280364d5 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1210 microversion: 2.1 time: 0.086388 Sep 09 12:29:44.638882 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 626/1227] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:44 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:45.661361 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:45.661929 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:45.668783 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:45.669253 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:45.669680 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:45.670633 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:45.671088 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:45.671507 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:45.693199 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-8f0aa5bc-1062-4881-8a3f-4015b31a34ac req-bed69c05-6085-4659-9d5f-044f16263611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d22a6742-33b8-45be-8815-9b6144fdf633", "tag": "fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:29:45.703927 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f0aa5bc-1062-4881-8a3f-4015b31a34ac req-bed69c05-6085-4659-9d5f-044f16263611 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:45.704632 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f0aa5bc-1062-4881-8a3f-4015b31a34ac req-bed69c05-6085-4659-9d5f-044f16263611 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:45.705074 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-8f0aa5bc-1062-4881-8a3f-4015b31a34ac req-bed69c05-6085-4659-9d5f-044f16263611 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:45.716278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-8f0aa5bc-1062-4881-8a3f-4015b31a34ac req-bed69c05-6085-4659-9d5f-044f16263611 service nova] Creating event network-changed:fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27 for instance d22a6742-33b8-45be-8815-9b6144fdf633 on hv-cinder-85221 Sep 09 12:29:45.721335 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-8f0aa5bc-1062-4881-8a3f-4015b31a34ac req-bed69c05-6085-4659-9d5f-044f16263611 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032292 Sep 09 12:29:45.722096 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 627/1228] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 09 12:29:45.937651 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:45.945984 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-7e94eae2-4aab-47c7-bd09-b3f99ab2cc6f tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.288631 Sep 09 12:29:45.946578 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 602/1229] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:45 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:46.969692 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:46.970434 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:46.976594 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:46.977075 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:46.977513 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:46.978242 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:46.978701 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:46.979127 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:47.107457 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:47.116550 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-21631ef5-bbdb-462a-ac06-8dc4e620a8a3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.151482 Sep 09 12:29:47.117143 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 628/1230] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:46 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:48.140451 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:48.141072 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:48.147567 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:48.148052 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:48.148496 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:48.149183 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:48.149643 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:48.150070 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:48.282076 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:48.290307 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fb231abe-2f2f-4876-93ac-fd60852880a0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.153882 Sep 09 12:29:48.290880 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 603/1231] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:48 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:49.313021 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:49.313628 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:49.320101 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:49.320578 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:49.321007 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:49.321696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:49.322172 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:49.322597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:49.455694 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:49.463317 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-4a0b7c4a-14bb-4b9d-bf4c-3ce208487dc2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.154194 Sep 09 12:29:49.463885 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 629/1232] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:49 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:50.487307 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:50.487858 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:50.490213 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=2 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:29:50.495675 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:50.496163 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:50.496607 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:50.497309 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:50.497769 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:50.498230 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:50.629502 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:50.637280 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-2955fe9d-c2dd-45f4-b561-f9700c672e90 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.154553 Sep 09 12:29:50.637857 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 604/1233] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:50 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:51.659950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:51.660577 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:51.667101 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:51.667585 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:51.668023 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:51.668713 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:51.669169 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:51.669626 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:51.797889 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:51.806233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-6553bbfb-f18d-474d-b481-c712246daff3 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.150093 Sep 09 12:29:51.806797 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 630/1234] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:51 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:52.829524 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:52.830075 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:52.832592 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell0:SELECT=8 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:29:52.838391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:52.838879 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:52.839323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:52.840017 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:52.840479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:52.840907 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:52.976708 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:52.984479 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-22c7ea70-5889-4475-b098-b5a5fe570aef tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.158935 Sep 09 12:29:52.985045 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 605/1235] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:52 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:54.006781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:54.007399 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:54.009356 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell0:SELECT=4 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:29:54.015596 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:54.016076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:54.016516 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:54.017205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:54.017669 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:54.018619 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:54.149443 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:54.157192 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-1ec3e225-ad4c-4f07-925a-8025a0891a80 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.154931 Sep 09 12:29:54.157758 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 631/1236] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:54 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:55.180917 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:55.181450 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:55.187825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:55.188299 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:55.188730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:55.189421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:55.189909 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:55.190358 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:55.319187 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:55.326891 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-c2c4c254-f6f7-47f6-8144-5a705a5acfe0 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.149914 Sep 09 12:29:55.327461 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 606/1237] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:55 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:56.350104 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:56.355433 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:56.363398 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:56.364357 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:56.364817 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:56.365597 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:56.366033 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:56.366502 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:56.499298 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:56.507376 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-450de882-b39b-4e01-b926-e1054ffdaf82 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.161158 Sep 09 12:29:56.507950 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 632/1238] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:56 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:57.529771 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:57.530371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:57.536714 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:57.537389 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:57.537825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:57.538572 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:57.539022 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:57.539440 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:57.674705 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:57.682555 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a9aeeeba-9c35-42af-b45a-67263c4dce62 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.156595 Sep 09 12:29:57.683121 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 607/1239] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:57 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:57.852556 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [req-012f3d0f-c419-4e17-832a-3e7b4214d705 req-00412335-1120-4766-8da1-2e0d435371ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d22a6742-33b8-45be-8815-9b6144fdf633", "name": "network-vif-plugged", "status": "completed", "tag": "fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27"}]} {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:29:57.863431 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-012f3d0f-c419-4e17-832a-3e7b4214d705 req-00412335-1120-4766-8da1-2e0d435371ca service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:57.863955 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-012f3d0f-c419-4e17-832a-3e7b4214d705 req-00412335-1120-4766-8da1-2e0d435371ca service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:57.864390 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [req-012f3d0f-c419-4e17-832a-3e7b4214d705 req-00412335-1120-4766-8da1-2e0d435371ca service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:57.876056 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.compute.server_external_events [req-012f3d0f-c419-4e17-832a-3e7b4214d705 req-00412335-1120-4766-8da1-2e0d435371ca service nova] Creating event network-vif-plugged:fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27 for instance d22a6742-33b8-45be-8815-9b6144fdf633 on hv-cinder-85221 Sep 09 12:29:57.882610 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [req-012f3d0f-c419-4e17-832a-3e7b4214d705 req-00412335-1120-4766-8da1-2e0d435371ca service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Sep 09 12:29:57.883396 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 633/1240] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:29:58.706730 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:58.707343 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:58.713736 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:58.714254 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:58.714696 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:58.715392 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:58.715854 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:58.716283 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:58.849679 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:29:58.857426 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-8f83e5a7-0537-4bed-b8f8-77ea31a3cc1b tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.155188 Sep 09 12:29:58.857991 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 608/1241] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:58 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:29:59.882157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:29:59.882864 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:29:59.889153 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:59.889634 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:59.890073 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:29:59.890808 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:29:59.891265 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:29:59.891693 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:30:00.030709 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:30:00.039119 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-9974066c-6669-4e2c-852d-e503b05647c2 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1266 microversion: 2.1 time: 0.162023 Sep 09 12:30:00.039726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 634/1242] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:29:59 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:30:01.062185 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:30:01.062820 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:30:01.069245 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:30:01.069719 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:30:01.070180 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:30:01.070864 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:30:01.071314 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:30:01.071776 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:30:01.204216 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:30:01.212168 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-5dbe312b-4310-46d4-b18e-3215d67a873c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1454 microversion: 2.1 time: 0.153872 Sep 09 12:30:01.212734 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 609/1243] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:30:01 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:30:01.234796 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:30:01.235411 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:30:01.242503 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:30:01.242986 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:30:01.243420 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:30:01.244113 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:30:01.244559 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:30:01.244985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:30:01.373076 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:30:01.381037 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4389af8-d1cc-4d98-aa55-27973bd21a24 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1454 microversion: 2.1 time: 0.150041 Sep 09 12:30:01.381601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 635/1244] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:30:01 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:30:03.345133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d22a6742-33b8-45be-8815-9b6144fdf633", "tag": "fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:30:03.354561 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:30:03.355050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:30:03.355482 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:30:03.366556 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] Creating event network-changed:fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27 for instance d22a6742-33b8-45be-8815-9b6144fdf633 on hv-cinder-85221 Sep 09 12:30:03.372158 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] [4e3be18f-6dfe-4b6a-b358-cb107ecd3009] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 09 12:30:04.380622 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] [4e3be18f-6dfe-4b6a-b358-cb107ecd3009] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38802. Sep 09 12:30:04.384082 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-bc5adf94-a413-4c83-ab34-81c052ea293d req-6f304825-702a-4424-a7c1-4c411b12bc60 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.102085 Sep 09 12:30:04.384787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 610/1245] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:32:05.900462 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_api:SELECT=28 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:32:05.904564 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f97fee8-8836-42ad-915f-2eefb6cc472d] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 09 12:32:05.905373 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG dbcounter [-] [120720] Writing DB stats nova_cell1:SELECT=52 {{(pid=120720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:32:05.906761 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:32:05.907020 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Fri Sep 9 12:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 (ip 10.222.0.62) !!! Sep 09 12:32:05.908046 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:32:05.908168 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Fri Sep 9 12:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 (ip 10.222.0.62) !!! Sep 09 12:32:05.912898 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:05.913393 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:05.917050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:32:05.917939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG dbcounter [-] [120719] Writing DB stats nova_cell1:SELECT=58 {{(pid=120719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 12:32:05.919326 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 09 12:32:05.919492 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Fri Sep 9 12:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.62) !!! Sep 09 12:32:05.925841 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-5cd35658-5cbf-479f-a287-97f789b8468b req-22f003b5-a8e0-47a1-867e-867095cc0f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d22a6742-33b8-45be-8815-9b6144fdf633", "tag": "fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:32:05.932601 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:05.933349 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:05.933967 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:05.934897 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:05.935511 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:05.936107 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:05.939130 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5cd35658-5cbf-479f-a287-97f789b8468b req-22f003b5-a8e0-47a1-867e-867095cc0f86 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:05.939613 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5cd35658-5cbf-479f-a287-97f789b8468b req-22f003b5-a8e0-47a1-867e-867095cc0f86 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:05.940270 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-5cd35658-5cbf-479f-a287-97f789b8468b req-22f003b5-a8e0-47a1-867e-867095cc0f86 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:05.951660 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-5cd35658-5cbf-479f-a287-97f789b8468b req-22f003b5-a8e0-47a1-867e-867095cc0f86 service nova] Creating event network-changed:fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27 for instance d22a6742-33b8-45be-8815-9b6144fdf633 on hv-cinder-85221 Sep 09 12:32:05.956742 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-5cd35658-5cbf-479f-a287-97f789b8468b req-22f003b5-a8e0-47a1-867e-867095cc0f86 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054060 Sep 09 12:32:05.957343 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 611/1246] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:32:05.969968 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:32:06.052088 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-571965a7-54b1-4064-a206-a86d58aff19d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 204 len: 0 microversion: 2.1 time: 0.153208 Sep 09 12:32:06.053158 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 636/1247] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:32:05 2022] DELETE /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 09 12:32:06.062391 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:06.063419 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:06.070490 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:06.071318 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:06.071834 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:06.072764 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:06.073426 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:06.074064 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:06.209217 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:32:06.216983 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-fe2f3872-252e-49a3-a00d-fdb1da7d8177 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1578 microversion: 2.1 time: 0.158964 Sep 09 12:32:06.217878 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 612/1248] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:06 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:32:07.242233 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:07.242974 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:07.249417 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:07.249903 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:07.250372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:07.251072 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:07.251530 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:07.251964 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:07.385249 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:32:07.393205 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-70a5f3ce-08bb-4bf2-a200-130322b30221 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1578 microversion: 2.1 time: 0.155766 Sep 09 12:32:07.393810 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 637/1249] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:07 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:32:08.324883 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-e5227222-e4a7-478c-8aff-0fc8ee1a0aac req-9acc9ed6-884a-4b82-ad11-9eee2a42eeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d22a6742-33b8-45be-8815-9b6144fdf633", "name": "network-vif-deleted", "tag": "fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:32:08.338290 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e5227222-e4a7-478c-8aff-0fc8ee1a0aac req-9acc9ed6-884a-4b82-ad11-9eee2a42eeb9 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:08.338629 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e5227222-e4a7-478c-8aff-0fc8ee1a0aac req-9acc9ed6-884a-4b82-ad11-9eee2a42eeb9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:08.339065 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-e5227222-e4a7-478c-8aff-0fc8ee1a0aac req-9acc9ed6-884a-4b82-ad11-9eee2a42eeb9 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:08.355825 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-e5227222-e4a7-478c-8aff-0fc8ee1a0aac req-9acc9ed6-884a-4b82-ad11-9eee2a42eeb9 service nova] Creating event network-vif-deleted:fd5977e0-7c1e-4fa5-8ef3-cf951b9f5c27 for instance d22a6742-33b8-45be-8815-9b6144fdf633 on hv-cinder-85221 Sep 09 12:32:08.359938 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f97fee8-8836-42ad-915f-2eefb6cc472d] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38854. Sep 09 12:32:08.363133 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-e5227222-e4a7-478c-8aff-0fc8ee1a0aac req-9acc9ed6-884a-4b82-ad11-9eee2a42eeb9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041545 Sep 09 12:32:08.364501 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 613/1250] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:32:08.416092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:08.416985 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:08.423227 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:08.423717 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:08.424148 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:08.424866 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:08.425303 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:08.425726 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:08.487971 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:32:08.495753 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-fb0b3337-8c06-4a5d-9d9b-b48cccb938c7 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 200 len: 1225 microversion: 2.1 time: 0.083446 Sep 09 12:32:08.496326 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 638/1251] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:08 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:32:09.520062 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:09.520696 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: d22a6742-33b8-45be-8815-9b6144fdf633] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:09.527308 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:09.527787 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:09.528224 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:09.528908 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:09.529364 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:09.529788 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:09.542897 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] HTTP exception thrown: Instance d22a6742-33b8-45be-8815-9b6144fdf633 could not be found. Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Request method failure captured: Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 HTTP/1.1 Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGzBtelaDXDWt4uLuVKzp7m-CUj86z9yAThoBjOAbzuHxA5vbzY75fhhXUQeISSVPc3nXsRCQ6AdUdLS1mq18zpPBSa2APiuiw6oOlbog635oQMVVDHq6PhYIC0HuHLqacvJGhcC0ZYykSEc_pYUAN0icflcZxFvpqc_fIOjHdUoeZH4 Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:32:09.544500 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b477593590943b88325822f014f0411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b477593590943b88325822f014f0411"}]}] Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: e7f34fed804446a98762e11bce9d7b3c Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance d22a6742-33b8-45be-8815-9b6144fdf633 could not be found. Sep 09 12:32:09.546371 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'd22a6742-33b8-45be-8815-9b6144fdf633'} Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d22a6742-33b8-45be-8815-9b6144fdf633 could not be found. Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:32:09.547603 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d22a6742-33b8-45be-8815-9b6144fdf633 could not be found. Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d22a6742-33b8-45be-8815-9b6144fdf633 could not be found. Sep 09 12:32:09.549485 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:09.551115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Returning 404 to user: Instance d22a6742-33b8-45be-8815-9b6144fdf633 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:32:09.551115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-39545b86-30cd-471e-91fb-1fccdef9a59d tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633" status: 404 len: 111 microversion: 2.1 time: 0.030190 Sep 09 12:32:09.551115 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 614/1252] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:09 2022] GET /compute/v2.1/servers/d22a6742-33b8-45be-8815-9b6144fdf633 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:32:12.627860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:12.628421 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:12.631404 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-b6782277-b33f-4fc3-aea8-b8a37c5fe7e3 req-a57638fc-f0bb-4f9a-a0d8-ce8691fda4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b48dc1bb-7b72-47a7-a0c0-5ed2f6176474", "tag": "18bd7910-811c-4714-82b3-59a2c55b4936"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:32:12.635532 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:12.636099 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:12.636630 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:12.637410 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:12.637994 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:12.638696 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:12.641927 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b6782277-b33f-4fc3-aea8-b8a37c5fe7e3 req-a57638fc-f0bb-4f9a-a0d8-ce8691fda4d5 service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:12.642454 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b6782277-b33f-4fc3-aea8-b8a37c5fe7e3 req-a57638fc-f0bb-4f9a-a0d8-ce8691fda4d5 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:12.642889 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-b6782277-b33f-4fc3-aea8-b8a37c5fe7e3 req-a57638fc-f0bb-4f9a-a0d8-ce8691fda4d5 service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:12.654772 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-b6782277-b33f-4fc3-aea8-b8a37c5fe7e3 req-a57638fc-f0bb-4f9a-a0d8-ce8691fda4d5 service nova] Creating event network-changed:18bd7910-811c-4714-82b3-59a2c55b4936 for instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 on hv-cinder-85221 Sep 09 12:32:12.660939 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-b6782277-b33f-4fc3-aea8-b8a37c5fe7e3 req-a57638fc-f0bb-4f9a-a0d8-ce8691fda4d5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035254 Sep 09 12:32:12.661809 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 615/1253] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:32:12.665368 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Going to try to terminate instance {{(pid=120720) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 09 12:32:12.751211 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-8b165ebc-ebb2-4323-b8ee-a84139e343c4 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 204 len: 0 microversion: 2.1 time: 0.127579 Sep 09 12:32:12.752419 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 639/1254] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:32:12 2022] DELETE /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 09 12:32:12.763909 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:12.764767 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:12.771853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:12.772353 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:12.772877 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:12.773509 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:12.773960 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:12.774425 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:12.912801 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.policy [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120719) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:32:12.921188 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-e4d91d23-3787-4752-aaa8-71f3538343ed tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1578 microversion: 2.1 time: 0.164402 Sep 09 12:32:12.921791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 616/1255] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:12 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:32:13.945905 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:13.946651 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:13.953084 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:13.953571 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:13.954013 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:13.954739 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:13.955195 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:13.955622 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:14.111157 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:32:14.119548 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-b2024ce5-9a03-4651-b393-03608d5fc253 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1578 microversion: 2.1 time: 0.178472 Sep 09 12:32:14.120125 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 640/1256] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:13 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:32:15.019470 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [req-d42e2d86-1ca8-4716-a879-9180039fbccd req-03a15861-89fb-4e0e-8133-ebcfc4a1e68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b48dc1bb-7b72-47a7-a0c0-5ed2f6176474", "name": "network-vif-deleted", "tag": "18bd7910-811c-4714-82b3-59a2c55b4936"}]} {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 09 12:32:15.029860 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d42e2d86-1ca8-4716-a879-9180039fbccd req-03a15861-89fb-4e0e-8133-ebcfc4a1e68f service nova] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:15.030375 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d42e2d86-1ca8-4716-a879-9180039fbccd req-03a15861-89fb-4e0e-8133-ebcfc4a1e68f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:15.031035 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [req-d42e2d86-1ca8-4716-a879-9180039fbccd req-03a15861-89fb-4e0e-8133-ebcfc4a1e68f service nova] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:15.043235 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.compute.server_external_events [req-d42e2d86-1ca8-4716-a879-9180039fbccd req-03a15861-89fb-4e0e-8133-ebcfc4a1e68f service nova] Creating event network-vif-deleted:18bd7910-811c-4714-82b3-59a2c55b4936 for instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 on hv-cinder-85221 Sep 09 12:32:15.048416 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [req-d42e2d86-1ca8-4716-a879-9180039fbccd req-03a15861-89fb-4e0e-8133-ebcfc4a1e68f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090161 Sep 09 12:32:15.049232 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 617/1257] 10.222.0.62 () {64 vars in 1317 bytes} [Fri Sep 9 12:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 09 12:32:15.143590 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:15.144182 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:15.151162 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:15.151638 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:15.152061 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:15.152788 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:15.153191 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:15.153604 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:15.223450 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.policy [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7f34fed804446a98762e11bce9d7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b477593590943b88325822f014f0411', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120720) authorize /opt/stack/nova/nova/policy.py:199}} Sep 09 12:32:15.231860 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-e82b5853-ded5-496e-91b0-874339d3c4ca tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 200 len: 1226 microversion: 2.1 time: 0.091873 Sep 09 12:32:15.232989 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 641/1258] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:15 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 09 12:32:16.256385 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:16.257077 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: b48dc1bb-7b72-47a7-a0c0-5ed2f6176474] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:16.263823 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:16.264298 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:16.264731 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:16.265421 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:16.265875 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:16.266332 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:16.279777 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] HTTP exception thrown: Instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 could not be found. Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Request method failure captured: Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 HTTP/1.1 Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGzBtelaDXDWt4uLuVKzp7m-CUj86z9yAThoBjOAbzuHxA5vbzY75fhhXUQeISSVPc3nXsRCQ6AdUdLS1mq18zpPBSa2APiuiw6oOlbog635oQMVVDHq6PhYIC0HuHLqacvJGhcC0ZYykSEc_pYUAN0icflcZxFvpqc_fIOjHdUoeZH4 Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:32:16.281401 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b477593590943b88325822f014f0411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b477593590943b88325822f014f0411"}]}] Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: e7f34fed804446a98762e11bce9d7b3c Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 could not be found. Sep 09 12:32:16.283207 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'b48dc1bb-7b72-47a7-a0c0-5ed2f6176474'} Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 could not be found. Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:32:16.284347 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 could not be found. Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 could not be found. Sep 09 12:32:16.286050 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.288325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Returning 404 to user: Instance b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:32:16.288325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-a7858d96-4007-4571-8241-b44bd812a403 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474" status: 404 len: 111 microversion: 2.1 time: 0.031009 Sep 09 12:32:16.288325 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 618/1259] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:16 2022] GET /compute/v2.1/servers/b48dc1bb-7b72-47a7-a0c0-5ed2f6176474 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:32:16.722166 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:16.722837 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.compute.api [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120720) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:16.729278 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:16.729781 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:16.730236 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:16.730922 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:16.731372 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:16.731786 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG oslo_concurrency.lockutils [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:16.747739 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.wsgi [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] HTTP exception thrown: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Request method failure captured: Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: request: DELETE /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc HTTP/1.1 Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept: application/json Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Accept-Encoding: identity Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Connection: close Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Length: 0 Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Content-Type: application/json Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Host: 10.222.0.62 Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: Openstack-System-Scope: None Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: User-Agent: python-urllib3/1.26.12 Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Auth-Token: gAAAAABjGzBtelaDXDWt4uLuVKzp7m-CUj86z9yAThoBjOAbzuHxA5vbzY75fhhXUQeISSVPc3nXsRCQ6AdUdLS1mq18zpPBSa2APiuiw6oOlbog635oQMVVDHq6PhYIC0HuHLqacvJGhcC0ZYykSEc_pYUAN0icflcZxFvpqc_fIOjHdUoeZH4 Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Id: None Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Domain-Name: None Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Identity-Status: Confirmed Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Is-Admin-Project: True Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Id: default Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Domain-Name: Default Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Project-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Role: member,reader Sep 09 12:32:16.749312 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Roles: member,reader Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b477593590943b88325822f014f0411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b477593590943b88325822f014f0411"}]}] Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-Tenant-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Id: default Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Domain-Name: Default Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Id: e7f34fed804446a98762e11bce9d7b3c Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: X-User-Name: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: method: > Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: exception: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.751092 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: action_args: {'id': 'e65a4779-7015-410f-99b0-668016bf8cdc'} Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:32:16.752336 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.753734 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.756091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Returning 404 to user: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. {{(pid=120720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:32:16.756091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-a50c58a3-3cb4-43a6-bcc7-4ee3890c8f1c tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 404 len: 111 microversion: 2.1 time: 0.032542 Sep 09 12:32:16.756091 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 642/1260] 10.222.0.62 () {58 vars in 1239 bytes} [Fri Sep 9 12:32:16 2022] DELETE /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:32:16.760243 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '>' {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:16.760853 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.compute.api [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] [instance: e65a4779-7015-410f-99b0-668016bf8cdc] Fetching instance by UUID {{(pid=120719) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 09 12:32:16.766732 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:16.767214 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:16.767645 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:16.768323 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Acquiring lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 09 12:32:16.768791 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 09 12:32:16.769189 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG oslo_concurrency.lockutils [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Lock "0bbb56c1-39d5-497b-b58d-1536df774c9a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120719) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 09 12:32:16.783703 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.wsgi [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] HTTP exception thrown: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Request method failure captured: Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: request: GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc HTTP/1.1 Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept: application/json Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Accept-Encoding: identity Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Connection: close Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Length: 0 Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Content-Type: application/json Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Host: 10.222.0.62 Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: Openstack-System-Scope: None Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: User-Agent: python-urllib3/1.26.12 Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Auth-Token: gAAAAABjGzBtelaDXDWt4uLuVKzp7m-CUj86z9yAThoBjOAbzuHxA5vbzY75fhhXUQeISSVPc3nXsRCQ6AdUdLS1mq18zpPBSa2APiuiw6oOlbog635oQMVVDHq6PhYIC0HuHLqacvJGhcC0ZYykSEc_pYUAN0icflcZxFvpqc_fIOjHdUoeZH4 Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Id: None Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Domain-Name: None Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Identity-Status: Confirmed Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Is-Admin-Project: True Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Id: default Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Domain-Name: Default Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Project-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Role: member,reader Sep 09 12:32:16.785239 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Roles: member,reader Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_2b477593590943b88325822f014f0411"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/2b477593590943b88325822f014f0411"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/2b477593590943b88325822f014f0411"}]}] Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Id: 2b477593590943b88325822f014f0411 Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-Tenant-Name: tempest-TestVolumeBootPattern-900860800 Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Id: default Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Domain-Name: Default Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Id: e7f34fed804446a98762e11bce9d7b3c Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: X-User-Name: tempest-TestVolumeBootPattern-900860800-project Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: method: > Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: exception: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.787268 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: action_args: {'id': 'e65a4779-7015-410f-99b0-668016bf8cdc'} Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: {{(pid=120719) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 09 12:32:16.788368 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. Sep 09 12:32:16.789990 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: ERROR nova.api.openstack.wsgi Sep 09 12:32:16.791495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: DEBUG nova.api.openstack.wsgi [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Returning 404 to user: Instance e65a4779-7015-410f-99b0-668016bf8cdc could not be found. {{(pid=120719) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 09 12:32:16.791495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: INFO nova.api.openstack.requestlog [None req-ededd101-49b4-4816-9dcd-d523d9a4d1fb tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc" status: 404 len: 111 microversion: 2.1 time: 0.030304 Sep 09 12:32:16.791495 dv-cinder-852210-13-iscsi devstack@n-api.service[120719]: [pid: 120719|app: 0|req: 619/1261] 10.222.0.62 () {58 vars in 1236 bytes} [Fri Sep 9 12:32:16 2022] GET /compute/v2.1/servers/e65a4779-7015-410f-99b0-668016bf8cdc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 09 12:32:18.077909 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: DEBUG nova.api.openstack.wsgi [None req-d4b1b3ae-17f1-46d8-9e79-dd4d359e1989 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] Calling method '.version_select at 0x7ff2dcb489d0>' {{(pid=120720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 09 12:32:18.101551 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: INFO nova.api.openstack.requestlog [None req-d4b1b3ae-17f1-46d8-9e79-dd4d359e1989 tempest-TestVolumeBootPattern-900860800 tempest-TestVolumeBootPattern-900860800-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1111752406" status: 202 len: 0 microversion: 2.1 time: 0.027541 Sep 09 12:32:18.102130 dv-cinder-852210-13-iscsi devstack@n-api.service[120720]: [pid: 120720|app: 0|req: 643/1262] 10.222.0.62 () {58 vars in 1263 bytes} [Fri Sep 9 12:32:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1111752406 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)